Yes, the main deal is that the fight/flight system gets triggered too often, even in inappropriate situations. The result is devastating.
And yeah, often you don't look at people, wear headphones or do other things like that. That's when you're doing "well" and not having panic attacks. When you've learned how to manage it.