I don't think it's so weird, part of the usability issue with headsets has always been having to take them off to interact with meatspace stuff. For me at least, a big part of that was it being really awkward to talk to someone next to you from inside the headset, even if you see them in passthrough fine, since you can't make eye contact. Not sure if this will be perfect or have a "my eyes are up here" effect, but it doesn't seem like a strange idea.