Yeah, has anyone seen the recent dramatic acceleration in GPU/TPU/etc computation? [1][2] Cost per flop has significantly decreased.

The reality is that moores law has petered out, but we have algorithms now (deep learning) which are optimized for parallel execution.

[1] https://en.wikipedia.org/wiki/FLOPS [2] https://aiimpacts.org/current-flops-prices/