> they make things harder, ... for those around them

Agreed. I think the point I'm trying to make is simple, to abuse your examples here: Your not giving a shit is neither my fault nor my problem.

And to generalize it, "Your problem with my personal trait is neither my fault nor my problem." Be that trait a disability, skin color, sexuality, gender, or nationality.

Because unfortunately disabilities are just targeted as all those other ones when people want a scapegoat.

I might be getting a bit philosophical, but that's what this feels like it boils down to. Person A is vocal about their dislike of something about Person B.