nVidia's Fermi chip has coherent L1 and L2 caches, and that is what is used in Amazon's GPU Compute cluster nodes. Branch-prediction and superscalar execution are still missing, but IMO aren't needed due to other architectural decisions on the chip.