top | item 46122091

(no title)

codybontecou | 2 months ago

Do all of these models, regardless of parameters, support tool use and structured output?

discuss

order

Y_Y|2 months ago

In principle any model can do these. Tool use is just detecting something like "I should run a db query for pattern X" and structured output is even easier, just reject output tokens that don't match the grammar. The only question is how well they're trained, and how well your inference environment takes advantage.

Ey7NFZ3P0nzAe|2 months ago

Yes they all support tool use at least.