In that case, I totally agree that you have a larger problem.
But my experience of adhd is not like that. My experience is that the only context in which other people give me a hard time about this sort of thing is if I talk about it in certain online communities. If you talk with a therapists or psychiatrist or if you read books by people educated in the field, you generally get useful help from a compassionate person. Heck, I've had good experiences talking with my bosses about this sort of thing. Mostly it's just the faceless internet trolls I've experienced espousing the views we are talking about, and I thing it's very easy (and very unhealthy) to get into a situation where it feels like faceless internet trolls represent how most people think.
My point is that talking about this sort of thing online is quite often super counterproductive.
(as to the larger issue... I can see what you mean about victim blaming... but I also point out that you could replace 'avoid' with 'ostracize' in my original post without really changing the denotation of my words, if you wanted more of a 'fight back' connotation.)