CPU memory to CPU cores is medium speed. That's why the CPU cores have caches, to make it faster.

CPU memory to GPU memory is slow. The other direction is even slower.

But GPU memory to GPU processing cores is insanely fast if you stream large amounts of homogeneous data.