my friend Henry Evans at Robots for Humanity[0] has done some testing with the Oculus Rift, he has much more limited range of motion than me and he was able to fly a Parrot drone fairly successfully. But I think when she start moving higher speeds than I think the latency is still a problem, although I've not had chance to test it.
At the moment I'm still trying to find people in the UK who can help me set up a similar sort of system, as at the moment I've been using the Parrot AR Drone coupled with NodeCopter[1] and the excellent ardrone-webflight plugin. FPV is my 100%, oh my god I'm flying from a wheelchair, ultimate dream setup, and I think I'm right at the beginning of that journey.
[0]:http://r4h.org/
[1]:http://ardrone2.parrot.com/
[2]:http://nodecopter.com/
[3]:http://eschnou.github.io/ardrone-webflight/