Speaking of which, could we apply vector embeddings to search engines (where crawled pages get indexed by their vector embeddings rather than raw text) and use that for better fuzzy search results even without an LLM in the mix?
(Might be a naïve question, I'm at the edge of my understanding)
> Speaking of which, could we apply vector embeddings to search engines (where crawled pages get indexed by their vector embeddings rather than raw text) and use that for better fuzzy search results even without an LLM in the mix?
Yes, this is how all the new dev documentation sites work now days, with their much improved searches. :-D
I'm talking about the scenario the GP referenced — where if you search for say "holiday" but get no results because the pages only use the word "vacation" which AFAIK is still a problem in regular search.
LLMs inherently would introduce the possibility of hallucinations, but just using the vectors to match documents wouldn't, right?
com2kid|6 months ago
Yes, this is how all the new dev documentation sites work now days, with their much improved searches. :-D
another-dave|6 months ago
esafak|6 months ago
another-dave|6 months ago
LLMs inherently would introduce the possibility of hallucinations, but just using the vectors to match documents wouldn't, right?