[gardenfelder]

It seems to be limited to certain LLM servers, on of which is OpenAI, none of which includes e.g. Mystral and popular OSS LLMs.

I wonder if that will change - eventually.

Discord channels are named in Chinese, though there are English posts.

[shekhar101]

It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.

[gardenfelder]

https://github.com/BerriAI/liteLLM-proxy

[rosspackard]

Looks like they do but aren't really documented yet:

https://github.com/infiniflow/ragflow/pull/119

[_akhe]

I see a `LocalLLM` chat model where it looks like you can pass a host/port (for example, ollama's)

[gardenfelder]

where do you see that?

[vissidarte_choi]

RAGFlow will support more LLMs, including locally deployed LLMs.