Hacker News Reader

Do you think there would be any demand for a separate service that makes it easy to screen scrape javascript heavy sites? (might be legal issues there though?)

(Sorry for all the comments, this concept intrigues me)

View on HN

I don't know. That was brought up in my previous posting, and I've had some people email me about it. It's hard for me to tell. I'm just not in that community enough to understand their needs.

I'm afraid that every scraping project is just enough different that it would be hard to write something that offered value to a lot of people.

That's probably a good point. I guess if someone wants to screenscape a dynamic JS heavy page they'd probably want to interact with the page.

Reply on news.ycombinator.com