Since SRAM is physically larger most of the bits would be farther away and thus the speed of light would introduce some latency (3D can reduce that latency but at even more cost).

But I think the real reason SRAM is not used is because it's trapped in an expensive/low-volume local maximum and there's not enough demand to push it into a cheaper/high-volume state. Caches actually work pretty well.