Scientists handle the increased data of the Large Hadron Collider

You should have a look at the CERN open lab project in which they use open stack to analyze the vast amount of data that they collect. Here are some YouTube videos about it: https://www.youtube.com/watch?v=DxOS3hY_BA4 https://www.youtube.com/watch?v=VOfRvZq5T6c

While my info is a few years old, I could give you a rundown of what we were using at Tier 1 (Fermilab) for data storage and analysis of detector data from the CMS detector if you're interested.