Hacker News Reader

I might have some data gotten through crawling them with Nuuton. Anyone from their team here? I'm going to check. Though not very positive, because I'm not currently scrapping ever single page completely.

Bad news update:

I had not covered the wiki yet. The crawler seems to have ventured off to SO (the crawler runs 24/7 by itself). I'm so sorry. :(

View on HN

Not to sound rude but what are you talking about? Why are you even apologizing?

I think he's saying that he set up a web crawler to scrape python.org, and he was hoping that in the process it had made copies of those Wiki pages. He's apologizing that, as it turns out, the crawler did not make it to those pages after all.

Exactly. I thought my crawler had covered all of python.org, but it strayed off to stack overflow. Had not noticed due to the sheer amount of data it goes through. On one side, this sucks because I cannot help put the wiki back online. One the other, this led me to discover this bug.

I'd expect they'll find a way to restore the wiki content. The bigger concern is that someone downloaded their password file.

Reply on news.ycombinator.com