Hacker News Reader

I don't get why the AI scrapers need to scrape the same sites and pages over and over again.

Because the scrapers are poorly written. Efficiency is not a concern for them.

Feels like parasites who are killing their hosts by DDOSing them to death