We can make devices that are fixed in space, where you need to orient your sensory inputs around the device. Or, we can make devices that instead are themselves oriented around your sensory inputs. The latter tends to be better for ergonomics and convenience (at least), since the device is accommodating your senses instead of your senses accommodating the device.
In other words, AR/VR/etc devices are headphones for the eyes. I can see why it seems like an obvious next step to some (if they can get it right).