Hacker News Reader

> I’ll also apologize if this post is a bit chaotic.

Loved this, didn’t find it chaotic at all.

Not sure if I missed it, but how are you planning on moving data from the old to the new storage? Do you have any concerns with corruption at that stage (validation)?

View on HN

It's already moved over. The data can be reduced to a fairly compressed form where it's about 1.6 TB in total, so it's easy to just tarball and check with an md5sum that it's the same on both ends.

As described in the post, a lot of the data is also heavily redundant so even if something goes wrong in one or a few places, the missing parts can be reconstructed from the rest.

Reply on news.ycombinator.com