HNHacker News
TopNewBestAskShowJobs

kkkkk11

2 karma · joined June 16, 2023

submissionscomments
kkkkk11··on Techmeme now links to Hacker News threads and other “forums” under its headlines
That's great, thanks!
kkkkk11··on Techmeme now links to Hacker News threads and other “forums” under its headlines
This is a really cool feature! Sometimes I enjoy reading discussion in forums, moreso than individual tweets.

I'd like to ask: how do you scrape news articles and the forums that have discussion on them? Do you use RSS feeds or do you use a custom web scraper? How do you group them together when they are related (i.e., clusters)? Have you considered making it open source or do you prefer to keep the secret "sauce" secret?

I regularly use Techmeme and I've always wondered about these things.