I'm at a standing desk on a balance board and I had to get off. I got disorientated and nauseous just watching that. I can't even imagine spherical geometry with VR.
As long as they cross in front of the eyes. If they cross in the back, the math works, but the brain is not trained for it.
In spherical geometry that happens -- you see things which are just behind you, but the brain has problems interpreting that.
Simulating binocular vision is not the only approach though -- you can use a perspective where the objects appear at the correct distances, some non-Euclidean VR games do this.
Mostly I've managed to make myself slightly ill with my own experiments in rendering motion in hyperbolic space, so I haven't spent too long in HyperRogue.