I'm confused. Why would you develop a game on a SBC (that's not powerful enough to do VR)? Why are you not just cross compiling?
It's possible that you can have a full open source stack some day on these goggles.. but I don't think that's something that's obviously going to happen. SteamVR sounds like their version of GooglePlay Services