HNHacker News
TopNewBestAskShowJobs

zlagen

167 karma · joined June 6, 2013

submissionscomments
zlagen··on Python is Slow, and I Don't Care
I guess you could use a connection pooler like pgpool-2?
zlagen··on Monitor web page changes with Go
lxml provides a module to perform html diffs mainly looking at the content rather than markup. It's not perfect but most of the times works. http://lxml.de/api/lxml.html.diff-module.html

For Go I don't know any.

When I was working on a project like this another issue that I found regularly is that there are regions of the page(counters, advertising, etc.) that change all the time too but they are part of the content. For this I would make several requests to the page and find the regions that would change in every request and disregard them when doing the diff.

zlagen··on Monitor web page changes with Go
This will break in a lot of pages as the html will be different on each request in most pages although the content will be the same. Perhaps it would be better to compare visible text rather than the raw html.
zlagen··on Show HN: Easily connect to a VPN in a country of your choice
Some people may use it as free proxies for web scraping.
zlagen··on PhantomJS 2.5.0 beta
Casperjs, which runs on top of PhantomJS has been nicer to use for me. Also Nightmare(http://www.nightmarejs.org/). The problem I always had with PhantomJS is that it's more difficult than it should be to automatize very simple website interactions. In Nightmare's homepage you can see a comparison between a script made in PhantomJS and one in Nightmare.
zlagen··on Ask HN: Successful one-person online businesses?
I'm interested in this kind of projects I have a lot of experience working with scrapers. How do you earn money from them? via affiliate sales?
zlagen··on Ask HN: Have any side projects from Show HN gone big?
Nomadlist: https://news.ycombinator.com/item?id=8107222
zlagen··on Show HN: Price changes alerts for any store
Here's an alternative for heuristic extraction which appears to handle more complex data: https://www.diffbot.com/
zlagen··on The PHP Weekly News Roundup
Nicely done!
← PreviousPage 2 of 2