[thedevindevops]

How does what you've described solve the coffee/espresso problem? You can't query SQL such that records like 'espresso' return coffee?

[brudgers]

Wouldn’t a beverage LLM would already “know” espresso is coffee?

[muzani]

Yup, that's exactly what parent comment is saying.

Let's say your beverage LLM is there to recommend drinks. You once said "I hate espresso" or even something like "I don't take caffeine" at one point to the LLM.

Before recommending coffee, Beverage LLM might do a vector search for "coffee" and it would match up to these phrases. Then the LLM processes the message history to figure out whether this person likes or dislikes coffee.

But searching SQL for `LIKE '%coffee%'` won't match with any of these.