top | item 46949050

(no title)

hasperdi | 20 days ago

Retail PCs will probably never catch up to even the open‑weight models (the full, non‑quantized versions). Unless there’s a breakthrough, they just don’t have enough parameters to hold all the information we expect SOTA models to contain.

That’s the conventional view. I think there’s another angle: train a local model to act as an information agent. It could “realize” that, yeah, it’s a small model with limited knowledge, but it knows how to fetch the right data. Then you hook it up to a database and let it do the heavy lifting.

discuss

order

myk-e|20 days ago

Maybe the industry adapts too and the future PC is AI-ready out-of-the-box. Because people demand that.