Hacker News Reader

This is what we used to do. Then send a large zipfile with schreenshots and other data to the lawyers to handle the contact. Shortly after the scraping usually stopped. The contact and sell access wasnt an option because it was competitors taking the data.

View on HN

I did some scraping for a lawyer back in like 01 from other lawyers. He got a c&d and told me to turn it off (we were done anyway).

Funny part was the lawyer on the other side wanted us to return all of the content on disk. Not show what we had copied but literally return it. My lawyer laughed about it. The other lawyer was smart/savvy enough to be effectively using the internet in 01 but didn't really understand the tech.

Other funny part is if he had generalized his site outside of law he would have had a major business these days.

> Funny part was the lawyer on the other side wanted us to return all of the content on disk.

I actually had a client that asked me to record a screenshot of me deleting their files from my computer. (and this was actually a developer making the request)

And this is why it's an excellent idea to always scrape behind proxies. Never scrape from your own IP, or one easily traced to you.

Reply on news.ycombinator.com