If you can make this a tolerable experience on the Oculus Go, it should only get better from there. After using several VR setups (including the Go), I think it might just hit the baseline sweet spot of affordability, ease of use and performance-- with the latter obviously being the biggest concern.

You might want to consider throwing in a quick check on internet speed & latency at the user's location, and simply not allow them to connect if it's not up to a certain level (or gracefully degrade the experience to a lower-bandwidth, more latency-tolerant secondary UI).