50B Restores and Counting
backblaze.com
backblaze.com
Other systems like restic manage to do this correctly, why not the biggest player in the backup space?
It’s like a honey pot. Advertise encrypted backups to become big, force server-side decryption when people really need their data.
That puts it a little more into perspective. That's a much, much smaller number.
Now, how many "Backblaze lost my files", or 'I couldn't restore my data" stories are there? Hundreds of those (I'm speculating) would be bad, statistically.
So in my experience they don't check data at rest very often. Unless you try to restore frequently, your data may be gone.
Reminds me of most places database backups... I always check to make sure they restore correctly, a lot of people just assume they will.
--
Other Engineer: We back up our database nightly! It's AUTOMATED and even copied to another data center in a different region!
Me: Have you ever tried restoring it?
Other Engineer: ... well, uhh, no... awkwardly pauses I mean why? scoffs and quickly walks back to desk
[two hours later]
Other Engineer: Holy shit, our backups wouldn't restore.... good thinking, mate. We would have been totally fucked.
--
You'd be surprised how often people don't check their backups, critical systems, restore functionality. Like just because you're doing it doesn't mean you're doing it right...
I personally think unless you somehow corrupted the data before failure, that Blackblaze sort of sucks hard here since this is literally their job. I hope they try to make it right somehow or actually figure out and find what caused that to happen.