top | item 47022752

(no title)

noodletheworld | 15 days ago

> Qwen3 8B, or even 4B quantized is actually quite good.

No, it’s not.

Trust me, I don't write this from a position of vague hand waving.

Ive tried a lot of self hosted models at a lot of sizes; those small models are not good enough, and do not have a context long enough to be useful for most everyday operations.

discuss

order

No comments yet.