That's not introversion. That's being asocial. People get those confused as often as they confuse introversion and being shy or quiet.
Oh, so you're a devil-may-care litterbug? Tell me more.
But only for humor or conversational interest. Rigidly rejecting folk colloquialisms is kind of annoying.