Full threadroll·interesting project. I was doing a similar thing with yahoo pipes, but it got blocked because of robots.txt. What do you do about it?View on HN