What if we just put all the RAM on the CPU die? Imagine the speedups for everyone!
I know, sounds crazy. Who’s gonna make such a drastic change to the industry?
I know, sounds crazy. Who’s gonna make such a drastic change to the industry?
Expanding the cache so everything fits in it is one way to achieve the performance uplift of cache hits, but cache is expensive compared to memory, and current cache sizes are tiny compared to RAM. If cache gets 50x bigger tomorrow, chips will get at least 10x as hot, power-hungry, and expensive.
[1] my understanding is that RAM and CPU processes are very different and it is hard to produce a chip with both features while remaining optimal.
Look into Apple’s unified memory.
> ... the available RAM is on the M1 system-on-a-chip (SoC).