[hasbot]

This is probably the wrong place to ask this, but why not use a locally run LLM?

[the_mitsuhiko]

You can.

[dcre]

Because they are too slow and not smart enough.