top | item 44828877

(no title)

makeramen | 6 months ago

But given the option, do you choose bigger models or more reasoning? Or medium of both?

discuss

order

paladin314159|6 months ago

If you need world knowledge, then bigger models. If you need problem-solving, then more reasoning.

But the specific nuance of picking nano/mini/main and minimal/low/medium/high comes down to experimentation and what your cost/latency constraints are.

impossiblefork|6 months ago

I would have to get experience with them. I mostly use Mistral, so I have only the choice of thinking or not thinking.

gunalx|6 months ago

Mistral also has small medium and large. With both small and medium håving a thinking one, devstral codestral ++

Not really that mich simpler.

namibj|6 months ago

Depends on what you're doing.

addaon|6 months ago

> Depends on what you're doing.

Trying to get an accurate answer (best correlated with objective truth) on a topic I don't already know the answer to (or why would I ask?). This is, to me, the challenge with the "it depends, tune it" answers that always come up in how to use these tools -- it requires the tools to not be useful for you (because there's already a solution) to be able to do the tuning.