The problem in HPC is less often pure CPU horsepower though, it is often cache or memory bandwidth, or in the interconnects.
I guess you might be able to build a system in the cloud to provide TOP500 level of performance, but it would be pretty hard even with the fancy EC2 HPC instances (http://aws.amazon.com/ec2/hpc-applications/).