[legrande]

Also needed: ai.txt declaring which AI bots are allowed or disallowed to scrape content

[organsnyder]

Couldn't this be handled in robots.txt?

[omoikane]

> Couldn't this be handled in robots.txt?

That would require knowing all the user agents that would scrape content, assuming that you want to only exclude AI scrapers and not search engines in general.

OpenAI's user agent is GPTBot[1], I am not sure about the others.

[1] https://news.ycombinator.com/item?id=37030568

[8organicbits]

Not well. You'd need to know which user-agent strings the AI scrapers use, which is impossible to enumerate.