top | item 39898012

(no title)

gardenfelder | 1 year ago

It seems to be limited to certain LLM servers, on of which is OpenAI, none of which includes e.g. Mystral and popular OSS LLMs.

I wonder if that will change - eventually.

Discord channels are named in Chinese, though there are English posts.

discuss

order

_akhe|1 year ago

I see a `LocalLLM` chat model where it looks like you can pass a host/port (for example, ollama's)

gardenfelder|1 year ago

where do you see that?

vissidarte_choi|1 year ago

RAGFlow will support more LLMs, including locally deployed LLMs.