Side note if you were to mount a camera on the hat/goggles and show the stream on VR goggles others could "share" the same experience.
Some people report motion sickness when using VR glasses; I think sharing the view would only make it worse for all but the guy in control.