top | item 46087406

(no title)

okeuro49 | 3 months ago

Do you run the models locally?

No local model for me manages to get function calling right.

discuss

order

spacecadet|3 months ago

Are you using LangGraph tool nodes? I run very small, non-RLHF instruction models with maybe a 2% failure rate on response format matching tool definition. I would also guess you do not have your orchestration and pipe configured correctly.