I really don't care for FPS games. Back in the days of Doom on 800x600 monitors, I would walk away distinctly queasy after 5-10 minutes. I'm fine in actual autos, ships, and aircraft.
The other problem with VR is that it's entirely isolating from the immediate environment (AR slightly less so). Even headphones allow visual monitoring, and for the record, I don't much care for headphones or earbuds either -- having sound in your ears is very different from it being in the space (e.g., room speakers).