This 2004 paper got a lot of attention in the computer vision community doing essentially the same thing about a decade ago:
http://www.cs.columbia.edu/CAVE/projects/world_eye/
"The World in an Eye," K. Nishino and S.K. Nayar, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol.I, pp.444-451, Jun, 2004.