Their anti-bot detection is pretty aggressive. The server insists I'm a teapot, and I haven't checked today, but I'm pretty sure I'm at least humanoid shaped.
> Lets make AI poisoning the norm. If we all do it, they won't have anything to crawl.
The AI companies are just going to filter out garbage better (hint: they already do), and the crawlers are going to get better at pretending to be human. The only change we'll notice is that the end user's experience has gotten worse.
Viewing this incorrectly flags my primary browser into the infinite tarpit but not a different browser. Perhaps a little too aggressive or not discerning enough?
I wonder what would happen if you served LLM-generated garbage to the LLMs if that’d be even better. Just massive amounts of fake content, plausible terrible code, incorrect legal cases, new math, horrible recipes, novels by famous authors that were never written.
dwattttt|7 months ago
davely|7 months ago
TheRealPomax|7 months ago
ronsor|7 months ago
The AI companies are just going to filter out garbage better (hint: they already do), and the crawlers are going to get better at pretending to be human. The only change we'll notice is that the end user's experience has gotten worse.
conartist6|7 months ago
Remember that it's the AI companies who are causing the pain. Others are just crying out in pain and trying to survive
knodi123|7 months ago
cobychapple|7 months ago
GaggiX|7 months ago
ChrisArchitect|7 months ago
Nepenthes is a tarpit to catch AI web crawlers
https://news.ycombinator.com/item?id=42725147
sgtppr|7 months ago
wpollock|7 months ago
tlavoie|7 months ago
tomsonj|7 months ago
HeavyStorm|7 months ago