Carmack talked about VR too, but I'm referring to the comments he made about framerate and latency in the context of Rage.

See http://www.computerandvideogames.com/videos/e3-2011-john-car... - around 16 minutes in he mentions how a few frames latency makes a big difference.

A lot of console games indeed have pretty awful latency, and don't get a smooth 60fps either. And TVs can add latency on top of that with the postprocessing they do.