[bluecrab]

Vector DBs should never have existed in the first place. I feel sorry for the agent startups though.

[m3kw9]

How does this absolve vectordbs

[dragonwriter]

If you are using OpenAI, the new Assistants API looks like itnwill handle internally what you used to handle externally with a vector DB for RAG (and for some things, GPT-4-Turbo’s 128k context window will make it unnecessary entirely.) There are some other uses for Vector DBs than RAG for LLMs, and there are reasons people might use non-OpenAI LLMs with RAG, so there is still a role for VectorDBs, but it shrunk a lot with this.

[danielbln]

It doesn't, but semantic search is a lot less relevant if you can squeeze 350 pages of text into the context.