Well, or you could render on the phone and stream to the glasses.
I don’t think even 5G is low latency enough for what you’re describing—not even close. Stadia works because it’s not VR, so they have some latency headroom. For good VR (Valve Index, etc), you get around 20ms for the entire rendering chain.