Hacker News Reader

Comment by toomuchtodo | Hacker News Reader

Worry not, I'm slowly assembling a massive Quora WARC file of all of the posts uncensored by the login wall (for cold storage). The moment they're out of business, a magnet torrent will be provided.

View on HN

Is this the explanation for your account name? ;-)

Actually, it is!

I'm notorious for taking on too many projects. Time to sleep when I'm dead.

Seems like kind of a paradox. Too much to do, so you'll sleep when you're dead. But sleep deprivation will kill you, so you won't be able to finish all those things that are keeping you busy. :)

I always get eight hours of sleep ;) if a project exceeds my time availability, and cannot be automated, I delegate, even if it requires paying out of my pocket.

Thats way more than my usual 4-6 :-)

I guess I should but I also love to have some time alone before the rest of my family wakes up (and before people turn up at work).

Thanks for doing this! There are so many people putting so much effort in writing detailed Quora answers on such a wide range of topics. All of that content disappearing whenever Quora inevitably shuts down/gets acquired would be akin to a library burning down.

Would you mind sharing your spider technology stack. How do you find new urls efficiently? What spider and what storage do you use? Do you append everything in one WARC file and split it if it gets too big?

Can you add ?share=1 to your spider to get all Quora's content?

That's what I do.

Reply on news.ycombinator.com