TrackIR is existing and mature product using the original idea.
Sure it requires extra hardware, but it's amazing in first person games that support it. You get to use your good monitor, don't get dizzy like in VR and it could be quite cheap.
I think implementing similar thing with just camera and computer vision is a good idea, let's make this more common thing.