Web scraping 101: pulling stories from Hacker News

blog.databigbang.com

2 pointswslh4 comments

There's an official API for HN that is much easier to use at https://www.hnsearch.com/api

There is a reference at the bottom to another article on hacking hnsearch to surpass their result limit.

The result limit is in the HNSearch API for performance reasons and hacking around that limit will hurt performance for other users.

I understand that, but hacking stuff is in our DNA...