Imo, the future is millions of micro-GPUs on a chip, with simplified instruction set. Such mGPU clusters will be called neuromorphic chips.
Btw, it's time to measure performance of LLMs in watts.
Btw, it's time to measure performance of LLMs in watts.