If you are having serious conversation where expression matters, just take it off or all person may wear it in the Metaverse. In current form it is gimmicky.
I would say that for quick, <10 minute conversations, it's fine. It's one of those things that doesn't seem impactful until you interact with it for the first time. I used to think the same way.
<10 minutes? If I think the conversation is going to take more than 30 seconds I am taking that thing off.
Care to imagine how much extra cost this gimmick adds to the device? A high definition second screen just so you can make "eye contact" with someone while simultaneously not paying full attention to them anyway.