So for now, with ambient temperature cooling, the best modern chips top out at about 5GHz. That will likely improve slowly with each process generation due to efficiency improvements, but it's not going to change much.
I suspect the real limit is in the size of the L1 and predecode caches. I expect they are limited by propagation delay, not transistor speed. The only way to get more cache is to use more cores.
And yes, caches are big regions and hard to make faster synchronously. But you can treat this with pipelining -- that's one reason even the 32k L1 data cache in SNB/IVB has a 4 cycle (!) latency. Note that the even the gargantuan L3 cache on these chips (which is literally 1/3 of the die area) is still running at full speed, just with a ~30 cycle latency.
Wow. I did not know the L3 cache ran so fast.
Doesn't really seem practical to run a datacenter using the methods in the video however. But, it's still possible.