Yes. It's like exercise. Or eating healthy. I don't enjoy working out but I should really be doing it. I really enjoy eating sweets, but I should not be doing that all the time.
Even if talking to people is beneficial (I can accept that), you're also shaming people for being introverts. Nobody should be faulted for enjoying me-time. It isn't even harmful. No, it's not like eating too many sweets.