When I play games I want to get OUT of my reality. I don't want every game being painted onto my lounge room.
It might be a great experience if you have a lounge room as stylish and clean and spacious as Bill Gates or Satya Nadella, but I have a small cluttered lounge room and I have no interest in playing games projected into that reality.
I'm holding a fistful of dollars which I am trying to throw at Sony as soon as they'll take it from me for immersive VR.