> memory is 10+ times slower than the CPU

The difference is much greater than that - one uncached RAM access can take hundreds of CPU cycles.