We are on the cusp of solving the peripheral vision piece, because 360 degree camera rigs are getting cheap and popular. As soon as they can stream in realtime, you could have low-latency VR as if your head was really on top of the robot.