Have you seen Pearl from Google's Spotlight Series? It's a VR film that shows how you can get around the "limitations" of VR: http://www.fastcodesign.com/3060252/dont-be-surprised-if-goo....
I definitely agree though. You can't just take what works in film and expect it to work in a VR film. It'll be interesting to see how filmmakers experiment with the medium as more and more start pushing what it can do.