Latency will always be a consideration though; the fidelity might get there in terms of audiovisuals, but you can't engineer around the speed of light.
I use a LiquidSky cloud gaming PC as my main games machine. For Overwatch, I have a ping of 1ms, as it's next to the OW servers, 40ms total ping from my home to LiquidSky. it's kind of amazing and works wonderfully
> Latency will always be a consideration though
And it will always be way too high for VR.
They could stream a spherical texture (with depth map). Locally you would only have to render the sphere from the view point of the eyes.
If we can get closer though, I suspect most people wouldn't be bothered.
It would basically double the current latency (about 100ms) by adding a 50ms trip to both receiving and sending. (And that's being generous -- it could easily add 100+ms to each trip.)