Gleb
525 karma · joined September 17, 2008
Gleb
You're also right that 1 TB is the approximate breakeven between Backblaze per-GB cloud storage & unlimited online backup by cost and most people are below that. However, the main reason for people to use the backup service is that we take care of all the backup functions (encryption, dedup, compression, restores, etc.)
> Please excuse me while I buy stock in Amazon/Box/Dropbox/Backblaze/etc....
Alas, Backblaze stock isn't yet available for sale ;-)
BTW, thanks for being a customer!
Gleb
To be clear on our philosophy - we don't want to restrict people from building these for their own purposes, modifying them, giving away the design, selling the boxes, etc.
Gleb from Backblaze
Having said that, we offer the ability to exclude folders and filetypes if you have certain things you want to backup later.
(Not disagreeing with anything you're saying...just fyi.)
Gleb from Backblaze
Love that you're fighting the good fight (along with the Internet Archive) to keep a history of the Internet.
It's not under any license, it's just 'free'. We've talked about putting the Storage Pods under a license, and may at some point since we get this question periodically and picking a license that people are familiar with may make it more clear that we really are giving away the design.
Also, when we work with contract manufacturers on building storage pods, talk with data centers about space, etc., it's really convenient to point to public posts to explain what we're talking about rather than having to put NDA's in place.
Overall it results in a lot of awareness and goodwill. It's incredibly gratifying after the team spends many late nights putting these together.
Gleb from Backblaze
Where are you buying 40 TB hard drives? I'd love to get some ;-)
We actually don't claim these are 'state of the art', more 'state of the inexpensive'. You can buy faster performance storage servers, more redundant servers, etc. But I believe these are one of, if not the, lowest cost storage servers per GB. (And of course, open source.)
BTW, I'm a fan of Dropbox (use it personally) and, in general, think there is a ton of value in developers, organizations, and companies sharing what they've learned about storage. The better and lower cost it gets, the more interesting things other people can do with it, the bigger the industry, and the more everyone benefits.
(full disclosure - cofounder of Backblaze here)
Here are my thoughts on our announcement today: https://www.backblaze.com/blog/b2-cloud-storage-provider/
Gleb
Are you planning on using the code in something?
Would love your thoughts and feedback, and to hear of what you do with this erasure coding library.
This data set releases 500 million data points on 41,000 drives. I imagine you guys here at YCombinator/Hacker News are the ones who'd find this data amongst the most useful. Enjoy and let us know what you find!
One quick note on this particular Supermicro system - it's slightly apples/oranges as the Backblaze Storage Pod is a complete server and this Supermicro system is a JBOD, meaning it still needs to be plugged into a server to work.
Gleb, Backblaze co-founder
We use consumer-grade drives across our entire 40+ petabyte storage farm because we do not need high-performance drives. Instead, we need low-cost, low-power, high-density drives to put into our custom-designed Storage Pods: http://blog.backblaze.com/2011/07/20/petabytes-on-a-budget-v...
We tested "enterprise drives" and found that from a pure reliability perspective, they actually performed worse in our testing than the consumer drives. With about 5 years and 40+ petabytes of data, we're fairly confident this holds true.
Finally, we assume that all drives will fail and replace about 10 drives every week. The software is written such that the system takes drive failures into account and data is stored redundantly and continuously cross-checked.