If you have a "legitimate scraping pursuit", identify yourself appropriately that way. I'm happy to let most well-behaved scrapers access my content.
Hiding behind a residential proxy and using random user agents? Gross. Learn what consent is.
Hiding behind a residential proxy and using random user agents? Gross. Learn what consent is.
You're thinking about the case of big AI companies crawling your blog. I'm talking about a small startup trying to do traditional indexing and needing to run from residential proxy to make it work.