Hacker News Reader

There's way too much data. Many group owners did not know of the shutdown (Yahoo was negligent regarding informing owners), and even if they did many group owners have little or no technical capability. That's why so many requested of the Archive Team that their groups be archived.

1000 members of a group each downloading 20 messages every 4 hours (a dribble that wouldn't be noticed) can pull down ... 20k messages in 4 hours.

Is that enough? What about groups with only a few members? Or members that have passed away in the last 20 years? Will those WWII vet groups have 1000 responsive members with the technical skill to run an archive script in the next week?

That's exactly what they're doing, and then they get CAPTCHAs and accounts banned.

Like.... Selenium or puppeteer?