Hacker News Reader

Local search index is the key to responsiveness.

Where does hacker books and hackertube get the data from? Is there a regular dump somewhere? Scraped, api?

I believe there’s a hackernews dump on google big query public datasets.

Also Hacker news does have a public API. It's ugly and awkward and they're never going to improve it but it's also free and not rate limited.