> pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai.
This feels like a very, very weak prediction (though certainly possible).
This feels like a very, very weak prediction (though certainly possible).
Since at least the 640kb quip, betting against progress or the appetite for progress has been a losing bet.
In the late 90s and early 2000s the mantra was "why waste time optimizing your software? By the time you're done the next gen of CPUs will have made up the difference."
Now the increase is more about moving to GPUs and power efficiency etc. We still have increases, but the rate of speedup has slowed down a lot.