I think the fact that the movie represents a part of your visual field makes it understandable -- the surrounding setting is stable. If everything around you changed instantly, your brain would have a hard time adjusting. Might be interesting when more sophisticated VR is available.