top | item 38699043

(no title)

pgbovine | 2 years ago

also, while i have your attention here, since you wrote that related post on (not) vector db's ... what would you recommend for a newbie to get started with RAG? let's say i have a large collection of text files on my computer that i want to use for RAG. the options out there seem bewildering. is there something simple akin to Ollama for RAG?

discuss

order

zzleeper|2 years ago

If you want to get something done quickly, try llama index.

If you want to learn/hack, pick an easy vectordb, get an OpenAI API account, and do a quick attempt

Then you can switch to a local LLM and embedder, and it helps a bit in learning what the pain points are