[elicksaur]

The AI is optimized for producing text that sounds like it makes sense and is helpful.

This is not a guarantee that the text it produces is a correct explanation of the thing you are asking about. It’s a mental trick like a psychic reading tea leaves.

[crazygringo]

I'm so tired of this caveat.

It's generally pretty obvious if the explanation makes sense. And you can locate the original paper(s) as well to verify.

And you know what? My PhD friends get things wrong all the time too. I need to verify what they say as well.

"This is not a guarantee"? You're right. Nothing is a guarantee, but a lot of things are awfully helpful.

[elicksaur]

I’m tired of “Well people get things wrong, too.” as a defense of these systems. They should stand or fall on their own merit.

And yes, reducing everything in the world - nothing matters. Everything is relative. What even is truth, amirite?

If that’s our slogan for the future then it is hella depressing.