I would love to see a version of this applied to both VR and AR but it seems that the current implementation is still slow for the performance that VR requires.
From the site: "During inference, our system operates at 25fps on 320x240 images and 4-5fps on 800x1100 images using a GTX1080 graphics card."
For good VR/AR experiences you'll want better FPS