Hacker News Reader

I was just thinking the same. I rely on Kimono for a few of my sites, so I'm looking around at what I could use instead. The first I thought of is http://import.io/, http://cloudscrape.com, or https://phantomjscloud.com/site/index.html, but I fear the same might happen to whichever I pick.

Does anyone have any suggestions on how to run something similar on my own server?

View on HN

You can use portia[1]. You can try out a hosted version at scrapinghub[2] or you can host your own. It's a web based spider creator like kimonolabs but the spiders it creates are just scrapy spiders. If you need to do something that the UI can't handle it's not a problem, you can extend it with a little python.

[1] https://github.com/scrapinghub/portia [2] https://scrapinghub.com

Download the Kimono desktop tool for Mac and unzip it. It is nothing but a nodejs based web application.

Reply on news.ycombinator.com