top | item 43429248

(no title)

notavalleyman | 11 months ago

> This was outputting a lie, presented as a fact, to anyone in the world that searched the name.

I think you are wrong.

From my understanding, the complainant opened a new chat window and typed "who is forename surname?"

The daydream machine then daydreamed some output text, as is it's function.

Likewise, you can go now to any llm and ask it a specific question like "what is the minimal cheese principle?" (Which I've just made up) And many will daydream a consistent answer for you. As is their function

discuss

order

ziddoap|11 months ago

>The daydream machine then daydreamed some output text, as is it's function.

These are not advertised as daydream machines.

They compete on how accurate they they are against various accuracy benchmarks.

The average person who uses them does so with the expectation of accurate results, you know, as they are advertised. Accuracy and speed are pretty much the entire business model.

notavalleyman|11 months ago

No, they generally do not compete on accuracy benchmarks afaik.

GitHub/openai/simple-evals is what I checked here, and no, openai do not compete on accuracy benchmarks as far as I can tell. So I'd be interested in seeing what led you to think that, and also what led you to earlier claim that anyone typing in the complainant's name saw the same hallucination.