Thanks for pointing out the HPC instances that Amazon has. A few commenters were saying that it's not really a supercomputer without a fast interconnect. Yes, they have that! You just pay more for those instances.
In my experience Amazon did a pretty good job setting things up. It's fun to play around with HPC instances, you can get some sweet performance.