>so if you don't want to get sued or blacklisted, you can do no kind of (detectable) scraping.

So why would it be hard to make scraping undetectable, anyway, unless you do it particularly incompetently? In theory, it seems pretty easy: use a browser string that matches an existing popular browser, and make sure to not load anything faster than a human would.