[throwaway4233]

I believe what the parent comment is trying to imply is that the search results are fetched/retrieved from Bing's own internal ranking vector(?) database and then passed to the LLM, which then converts the received documents into a more human readable format and fills in any missing gaps in the information with it's own data.

So the gaps are the only areas where the LLM can hallucinate on and if your search query is easily available information on the internet, then hallucinations will be less or none.

Edit: I have used RAG with a project that I am working on and it's quite hard to ascertain if the LLM used the information provided as part of the RAG documents or just made up information on it's own, since even without RAG, we were getting similar responses 7 times out of 10.