For one of the first projects of this type (from 2006) see http://www1.cs.columbia.edu/CAVE/projects/world_eye/.