From what I remember, most of the stigma was always having a camera pointed directly at the person you were talking to at all times. That was just needlessly "socially aggressive" on Google's part.
The tech was definitely a cool proof-of-concept and the route I wish VR/AR would have taken. AR has so many more impactful use cases - think a navigation HUD or hands-free control of music while driving/biking or doing other things with your hands.