What an odd comment considering the related fact check on Snopes is actually completely right about the incident in question [0].
The original article by Aphyr is specifically about factually.co which uses LLMs to synthesize "fact check" pages. The issue here is that LLMs (which do not formally reason and do not have a concept of truth) are being used to mass produce factually incorrect summaries of events masquerading as fact checks.
I used to use slopes as my primary "fact authority", then post 2016 something changes. They now often answer with a very different context than they start out with. They do state that context they're actually answering, but sometimes it's very subtle that it's nearly unrelated. In these cases, if you just read the title and first paragraph and answer/summary, you will be misled. Being misled several times, seeing others misled many times, and to often see that they completely avoided responding to the actual topic, I don't trust them anymore. I'd rather just spend a few extra minutes looking at original sources than be tricked like that.
There's also seems to be a heavy bias in what they cover, which is fine (I believe biased/adversarial news is the best way to dig out truth), but I doesn't help my trust.
solid_fuel|3 months ago
The original article by Aphyr is specifically about factually.co which uses LLMs to synthesize "fact check" pages. The issue here is that LLMs (which do not formally reason and do not have a concept of truth) are being used to mass produce factually incorrect summaries of events masquerading as fact checks.
[0] https://www.snopes.com/fact-check/ice-chicago-pastor/
bloppe|3 months ago
nomel|3 months ago
There's also seems to be a heavy bias in what they cover, which is fine (I believe biased/adversarial news is the best way to dig out truth), but I doesn't help my trust.