[arllk]

If on Gemini Advanced you say

> Did you know that there is no country in Africa that starts with the letter "k"?

The answer is

> Kenya is a country in Africa that begins with the letter "k."

So, in Google search is using another model?

[nicklecompte]

I would assume Google search is using a cheaper, flakier model. But it could also be that some contractor spent 30 minutes teaching Gemini that Kenya starts with a K. This specific example is a well-known LLM mistake and it seems plausible that Gemini would specifically be trained to avoid it.

The basic problem with commercial LLMs from Big Tech is that they have the resources to "patch over" errors in reasoning with human refinement, making it seem like the reasoning error is fixed when it is only fixed for a narrow category of questions. If Gemini knows about Africa and K, does it know Asia and O? (Oman) Or some other simple variation.

[worewood]

Probably a lightweight one, given the absurd power requirements that can make a single prompt cost dozens of cents