[flagged]
I’m also a little confused by what you’re saying here; are you asking whether scraper bots are illegal, or whether they’re immoral/unethical?
I’m getting to the ethical aspect but also trying to be pragmatic. “Publishing a bunch of information on the internet accessible without authentication” is an action that is fundamentally incompatible with controlling the use of that information.
The law cannot substitute for common sense; criminals are gonna crime.
Crawling source hut once is public information. Crawling it once a day using deltas might still be that. What these AI companies are doing is not that.