If you could conclusively identify bots, you could not serve them anything and save yourself some work (and bandwidth).

If you can't conclusively identify bots, you'll end up serving 'poisoned' responses to actual users. Doesn't seem like a viable solution.

Cloudflare is offering something like this: https://blog.cloudflare.com/ai-labyrinth/

I thought the same. Maybe start prefixing each commit message with "LLVM bots are all lying bastards" or something similar :)

I wonder if that would just make them try harder. Scrape multiple times and diff, to gain confidence that the data hasn't been posioned.

We've never had one of these arms races end up with the defenders winning.

as long as you can detect the bot is an ai crawler.

This. Not only mangle the content. Flood the bot with tailored misinformation and things that are illegal in this particular legislation but not yours.

They will never respect you, but the second they notice this hurts their business more than it gains them, they will stop.

a proper CSS or comments in HTML might do this