People who don't care about other people's opinions aren't that common and aren't called extroverts. They're generally called sociopaths :-)
Actually the definition of extraversion is deriving gratification from that which is outside the self, so I'd say it's actually introverts who are less likely to care what others think.