I disagree. Articles written by AI are inherently less trustworthy (they're notorious for fabrications and hallucinations) and often have a very low content density. "Write me a 10 paragraph article about high hardware prices for my blog" is the sort of thing that expands to a lot of fluff with not a lot of content. I don't really want to read that article.
Even if AI might (might) be justifiable as an editor, it's still such a negative signal for "is this worth reading?" that in my opinion it is worthwhile to point out and discuss.
This case is interesting, because it seems obvious that the AI accusation is just plain wrong. The article is riddled with the kind of grammatical and spelling mistakes that humans regularly make but that a modern AI would never make.
I agree that AI-written text often has a low content density. I wonder if it's a matter of information theory.
Information theory defines the information of a symbol as being related to how often it occurs and how often it is expected to occur. Something that isn't expected carries more information. (Usually "symbol" is defined as one character or byte, but it could be a word or word part.)
Well, if you think about LLMs that way, they give you the most-probable next word (or word part). That means that they give you less information than normal writing. I suspect that's why it reads as bland, low-content - because it really is low content, in the information theory sense.
Now, it doesn't always give you the most probable next symbol. There is some randomness. And you can increase the randomness by turning up the temperature. But if you do, then I suspect it becomes incoherent more quickly. (Random gibberish may have high information from an information theory standpoint, but humans don't want to read that either.)
Maybe it's because no matter how it was done this is a boring piece that talks about the tiny tiny minority of higher numbers obsessed "gamers" that do upgrade their hardware yearly.
It's not even representative for gamers as a whole.
And starting from that, it's easy to also accuse it of being LLM generated, even if it isn't.
I have no opinion because I couldn't go past the first paragraph. It's not talking about any subgroup I can identify with.
Also after skimming it didn’t say anything new or insightful. No matter if “content creator” or “AI”.
exmadscientist|3 days ago
Even if AI might (might) be justifiable as an editor, it's still such a negative signal for "is this worth reading?" that in my opinion it is worthwhile to point out and discuss.
bryanlarsen|3 days ago
AnimalMuppet|3 days ago
Information theory defines the information of a symbol as being related to how often it occurs and how often it is expected to occur. Something that isn't expected carries more information. (Usually "symbol" is defined as one character or byte, but it could be a word or word part.)
Well, if you think about LLMs that way, they give you the most-probable next word (or word part). That means that they give you less information than normal writing. I suspect that's why it reads as bland, low-content - because it really is low content, in the information theory sense.
Now, it doesn't always give you the most probable next symbol. There is some randomness. And you can increase the randomness by turning up the temperature. But if you do, then I suspect it becomes incoherent more quickly. (Random gibberish may have high information from an information theory standpoint, but humans don't want to read that either.)
inahga|3 days ago
nottorp|3 days ago
It's not even representative for gamers as a whole.
And starting from that, it's easy to also accuse it of being LLM generated, even if it isn't.
I have no opinion because I couldn't go past the first paragraph. It's not talking about any subgroup I can identify with.
Also after skimming it didn’t say anything new or insightful. No matter if “content creator” or “AI”.
RGamma|3 days ago
Should we allow this to normalize, then I'm done with this part of the internet. (And I agree, one has to use this criticism with some care)
unknown|3 days ago
[deleted]
dpc_01234|3 days ago