Hacker News Reader

Comment by leejoramo | Hacker News Reader

Thanks for the link to Wallabag, I had never heard of it. Looks very interesting.

I use Pinboard, and pay for the archiving option. I even periodically request a tarball of the archive for my own backup. Pinboard archives the entire page, not just a readable version of the content. For archival and reference purposes, I like this. It would be nice if Pinboard also provided a readable option. In fact, a number of the apps that work with Pinboard add support for readable versions.

I will look into adding Wallabag into my workflow.

View on HN

I'm cool with the idea of providing a readable option in Pinboard, since I already do something similar to get the text out of the page for indexing. Any library for this you particularly like?

Readability (https://github.com/luin/readability) is a classic, and included as part of Firefox (I think, maybe that's been discontinued). It's essentially a bag of hand-written heuristics but they're pretty good heuristics.

Some interesting reading is Christian Kohlschütter's thesis on this problem, which is framed in academia as "how do we assemble good text corpuses from webpages for data analysis, which means removing junk (boilerplate) from our HTML crawls" (https://code.google.com/archive/p/boilerpipe/wikis/WSDM2010P...). Boilerpipe would probably be the right way to go, but if you're not using Java it could be harder to integrate.

I second Readability, it works great for article heavy webpages. I used it to build a reading time estimator for chrome https://chrome.google.com/webstore/detail/read-time/nccohhim... and its open source https://github.com/usergit/read-time bonus, you can click on the extension to show only the main content of the page

Thank you and the parent both for these links!

It works great! I used the Pinboard API to download my bookmarks and used readability to crawl the original text from the source url.

Firefox maintains a fork of Readability for Firefox's reader mode here:

https://github.com/mozilla/readability

I would very much like to see this.

I don't know what is the state of the art for a general content extractor. (I have done a fair amount of one off web scrapers, for data collection, but nothing this generic)

This would be great! A while back I signed up for Paperback (https://readpaperback.com/) to handle this for my Pinboard account, and then wrote my own using the Ruby Readability library.

Hopefully you see this. The biggest reason I stick with Pocket (despite the privacy implications) is because of its text-to-speech functionality. AFAIK, Pinboard is a website only, so TTS is out of the question. However, might this change in the future?

There is a great app called Voice Dream reader on iOS that takes text from a variety of sources and can do TTS. I think I paid $9.99 for it and bought an Inova voice for $4.99. I love it. I use it to have custom study guides read to me, ePubs, PDFs, text documents and my Instapaper queue.

Thanks, I'll check them out. Although from what I can tell of Voice Dream it's a big extra step in the workflow.

Instaparser, when it was originally released, was priced competitively with Diffbot: https://www.diffbot.com/products/automatic/#article

Which is a nice API for extracting metadata from a web page, although I understand it might not be worth the cost.

Paperback offers a reasonably good reading experience for Pinboard links.

https://readpaperback.com

Paperback looks interesting. I don't see it mentioned, but does it support highlighting & notes?

The demo seems to be broken for me.

One option is to have a browser that can render webpages in reading mode like safari on iOS. Hopefully chrome and Firefox have extensions as well.

They do

On Android FF has this functionality built in. I use it all the time.

Reply on news.ycombinator.com