Hacker News Reader

Fulton History is particularly frustrating as it’s a passion project and amazing resource, but the owner is a little… mercurial.

It will absolutely die with him. Its unfortunate that when the NYS Legislature appropriated money to scan thousands (millions) of newspapers to microfiche, they did not provide any funding for digitization.

> Glad to hear people have reached out to help, but the sad thing is for every project like this there are a hundred more that die a quiet death every year.

CDROM is a terrible way to store data. Any frontend to dd could back the CDROM up 1:1. That should be the first and primary focus. After that and an upload of however long (depending on internet connection), the wisdom of the crowd could be utilized. Even if the requirement of Windows 98 is correct, any VM (perhaps even ReactOS) could access it.

IIRC, there used to be a dd-like tool, maybe cdrescue? (a Linux command-line tool), that would recheck the data extracted, and then do a "best of n" check on any spurious sectors of the disc.

It's been at least 10 years since I had a CD/DVD drive though, so it might have been a mode of one of the dd_rescue/ddrescue/dd-rescue programs??

Probably just ddrescue by GNU, which can also be used on CD drives.

For audio CDs, I've always used EAC [1] with secure mode. I believe I even used it within Wine. It yielded better results than cdrecord.

Morgoth, FlashFXP, Preee, hkSFV, DCPP, and all that beautiful Windows software also worked in Wine.

[1] https://www.exactaudiocopy.de/

> I often hear suggestions like "let Ancestry take them over" or "the Internet Archive is the solution." I have to ask: Will either be operational in 20 years, or the data on them as easily accessible as they are now?

And on the pedestal, these words appear:

My name is Ozymandias, King of Kings;

Look on my Works, ye Mighty, and despair!

Nothing beside remains. Round the decay

Of that colossal Wreck, boundless and bare

The lone and level sands stretch far away.

https://poets.org/poem/ozymandias

I think any resource of data like this - assuming it's a noncommercial project - should have an export functionality available at all times, and an ask to any visitor to download the file, archive it, and clearly label it.

I like to believe that the best data repositories are the ones that are forgotten.

That said, I hope someone comes up with a consumer-affordable, long-term storage medium soon.

It a lesson in how important it is to choose the most open/free and widely supported formats when creating information you want to share with the world.

I find myself thinking about the conundrum of long-term digital archiving pretty often. It's a very interesting question.

I think the first biggie is non decaying storage. Outside of some paper, everything seems to decay fast, and even if stored correctly. Film goes bad in climate controlled vaults at times.

Those DVDs made of rock supposedly last a long time, but it would be nice to have something that lasts 1000s of years.

If you're talking about analog archival that is a whole other ball of yarn, but in terms of digital then I would think that the thing to do is use only lossless compression, bit-level fidelity error correction, and multiply-redundant, multi-region storage. You must plan on storage media, providers, and entire networks partitioning, disappearing, and failing.

You have to actively have an archive, with archivists. The geek stuff is secondary.

Something that can only survive if it has long-term funding is not really a solution to long-term archival.

Why not to donate this data to a nearest library?