That's not what they're saying. They're talking about things that couldn't be done due to performance issues but are now possible thanks to improved hardware.
The AI boom is almost entirely a thing due to advancements in hardware. You simply couldn't build ChatGPT with 2014 hardware.
If you started from scratch you'd never even consider doing anything other than the original obvious "correct" maths. Approximation be damned.