Hacker News Reader

Comment by marginalia_nu | Hacker News Reader

Tangentially on this note, if anyone is interested, I can produce a list of every RSS feed known to the marginalia search crawler. It's a pretty noisy list, but any thing I can do to help the spread, discovery and adoption of RSS I'm happy to help with so just let me know.

I a tool in place to export this data to help power the experimental RSS preview feature[1], but haven't had the inspiration to do much with that yet.

[1] e.g. https://search.marginalia.nu/site/jvns.ca

--edit-- Ok so there was interest. Give me a moment, I'll need to run an extraction script. Check back in a few hours or bookmark https://downloads.marginalia.nu/exports/

View on HN

I would be very keen to have access to that list and to, ideally, have a go at cleaning it up and producing a topical subset for broader use in certain fields I'm interested in (e.g. all the "developer blogs", say). I offer an OPML file of several hundred engineering/dev related blogs at https://engineeringblogs.xyz/ but I'm starting to think a little bigger.

I'd be keen on this and would import all of them into Recess (https://app.recessfeed.com) - also working on RSS adoption and discovery!

Alright, about half a million RSS feeds available at: https://downloads.marginalia.nu/exports/ [select feeds.csv]

The data is, as mentioned, pretty noisy. It's a best-effort guess as to which is the canonical RSS feed for the particular domain. There doesn't appear to be any convention for specifying this, so when there's multiple a fair bit of guesswork is involved. Expect a fair number of dead URLs, lots of spam from CRMs that generate uninteresting feeds.

Isn't there a way to integrate this type of info into the actual search engine? Ie, search for type:rss or atom and return the links to the RSS feeds?

[edit] I mean, to have it closer to what OP showed.

I know the Google search console lets you upload a site map, which can be an RSS feed, so the information is readily available. I suspect Google isn't incentivised to promote RSS, especially after they killed Google Reader.

I started a submission based platform ( bao.social but not currently resolving) as a side project because I missed the accessibility for RSS. would be keen on the list or even just connecting with you and OP

Feel free to shoot me an email if you want to have a chat, bounce ideas or whatever. That goes for other people as well ;-)

I'm a bit busy with finalizing my grant-funded work in the immediate future so reply times may be a bit slow, but such is life.

That would be _so_ cool! What an amazing resource that would be.

I think the community would be interested in list and you'd get a lot of downloads if you offered it up.

Reply on news.ycombinator.com