[pratik_kanthi]

an extension seems the most natural way to do this, but that would entail hosting a model which isn't cheap, will give it a go

[IncreasePosts]

Can extensions connect to localhost? IE to a local ollama for example.

[pratik_kanthi]

Yes they can. But the ergonomics of that aren't great. Also ollama takes up a sigificant amount of memory. I'm trying this with a cheap model like phi-3 hosted on my server.