Spoiler: the way out is "Domain Specific Architectures".
Spoiler: the way out is "Domain Specific Architectures".
I regret we're about to hit the wall but I have long though that we're going to start moving back to analogue, and probabilistic algorithms, and in one way, having half-width floats is a step in that direction. I expect it to go further.
(All this is my opinion and may be wrong).
And we are already there for some workloads. AI and crypto mining come to mind.
Regardless, buying a fast computer that could do anything was really fun.
Like the Amiga? That actually worked out pretty well. I look forward to it.
Would you rather have a burnt on silicon algorithm for video/encryption decoding or a 10X faster general purpose CPU that can do that and everything else?
We where doubling our performance every year or two. For decades.
Eg GPUs have been around for ~25 years and there's still no decent way to portably program them. We have Metal, Direct3D, OpenGL, OpenCL, Cuda, Vulkan, ... all of which have small market shares. It's markedly worse than microprocessors at 25.
(Not even getting into quality issues like driver quality problems and the closed&proprietary nature of most of the SW stacks).