[nighmi]

We had seen interesting developpments around vector databases, but then people stopped hyping them as you could just save them in normal databases without real differences. I wonder what will happen when the models can freely access them though.

[ENGNR]

Curious, do it mean saving into Postgres with pgvector, or some other technique?

[EGreg]

I really don't understand how people figure out the vectors to actually store in the databases, regardless of the underlying storage model.

Isn't that itself the province of an LLM? Say I have a bunch of text. How do I save the text search "by similarity"? Sphinx and semantic search was hard, I remember. Facebook had Faiss. And here we are supposed to just save vectors on commodity hardware BEFORE using an LLM?

[mewpmewp2]

I had scaling issues with pgvector. So would also like to know what regular db can scale?