However, in terms of the accessible hardware I think we already have that practically limitless supercomputing power in our hands. The paradigm shift is in the realisation that "your computer" is a device that computes things, regardless of where it computes things, rather than being the beige box in the corner. With a little code and enough cash I can access millions of CPUs and terabytes of RAM from my phone. The fact that computing power isn't actually in my phone doesn't matter in the least.
The computing revolution is the network, not the CPU.