VR barely works on the desktop with highend hardware and even then it's far from optimal. It will take a long time until that trickles down to mobile.
Unless they invent/integrate tech like Project Tango into most phones and make it work for spatial location this is not a problem that can really be solved on mobile.