It’s probably less about the sunglasses specifically and more about seeing the person’s eyes. Many neurotypical people think it’s rude to not maintain eye contact during conversations.