Virginia Tech unveils HokieSpeed, a powerful new supercomputer for the masses
vtnews.vt.edu
vtnews.vt.edu
Small world, I'm also a '03 alum. I was just going through my address book and a Scott S. was in the list with a 540 area code. We might have been in a study group at one point.
Beowulf was still in the experimental phase. Researchers were building 5-20 node clusters. IIRC, there weren't any Beowulf clusters you would consider supercomputer at that time. Keep in mind the fastest supercomputer at the time cost $400 million and this one cost just $5 million.
But whatever, some publicity stunt. They were stupid enough to waste money upgrading and expanding it because no one was using it.
System was built in 2003 - 8 years ago. Assume moore's law of doubles every 2 years - expectation of 16x more powerful Actual increase in performance - 22x in 1/4th the size
Given that it's then a quarter of the size of system X, that's an amazing increase in peak performance.
There's only one problem - that speed increase appears to owe a lot to the use of GPGPU. As I understand it, whilst research into GPGPU for HPC* is a hot area at the moment, the scale of the actual benefits it offers is still a matter of debate (especially when considering costs and power consumption).
In short, parallelism is not enough to get benefit from using GPUs. You need parallelism and data reuse.
"The Virginia Tech team is figuring out how to best to farm out computing jobs so that the GPUs and CPUs do what they do best, without ever going idle, and without spending too much time communicating with one another.
It’s not easy, but they’re using HokieSpeed to build tools for designing and compiling software so that it can be tweaked to run fast on these systems. They’ve also built what they call an “automated runtime system,” which works with the supercomputer’s operating system to speed things up even further."
I think the 'supercomputing for the masses' part comes from the fact that the peak performance of a relatively low-cost GPU is large compared to a CPU, but actually taking advantage of that performance is still difficult. They're aiming to change that with improved software development tools. At least, that's what I gathered from the article.
Here's a link to research they're doing on GPU computing: http://synergy.cs.vt.edu/
The highest cost for supercomputers isn't the raw hardware - it's the power consumption. This also includes the cooling needs of a large cluster. Over the lifespan of a cluster, these will add up to a significant multiple of their base cost.
* of course, this may not be the ideal way to provide access to these services
This is one of my favorite things about technology. As few as five years ago I was drooling about an Intel C2D chip and looking forward to quad-core chips. Nowadays that's standard technology in smartphones. I'm amazed by the graphics performance in the new Asus Transformer Prime with the Tegra 3 chip which has up to five cores.
The biggest problem with packing more power into smaller spaces is the battery consumption issue. Maybe there's no silver bullet for that only more efficient software and hardware usage.