One aspect of it, that has always been a part of the package, is that folks Just. Don't. Like. Me.
Most, if questioned about their dislike, may come up with a couple of things, like "He's abrupt," or "He's arrogant," but these are also exactly the traits present in many folks that they do like. They are just trying to justify this "feeling" that they have about me.
As anyone in my shoes can tell you, we're "bully magnets." Most of us were recipients of multiple atomic wedgies, in school. My grade school days were a living hell. Again, there's no real "reason" for the hate. There's just something about us that pisses them off. I suspect that the "resting bitch face," prevalent amongst us may have something to do with it. It often looks as if we're being hostile, when we're not. I spent many years, training my "resting" face to be one that's basically "harmless dork," as opposed to "angry bastard." Doesn't win me a lot of respect, but, at least, I'm not being attacked out of the starting gate, anymore.
I've gotten used to it. It doesn't even really bother me too much, these days, and it happens a lot less. Feeling sorry for myself is a waste of time. I used to get all butthurt about it, but that was just stupid of me. Others have far worse crosses to bear. In the aggregate, it's been a good thing. I'm fairly decent at my software development.
The folks that matter, stick around. I do have a fairly large circle of close friends and associates that don't let my "oddness" get in the way, and enough folks have respected me, that I was able to make a decent living.
But many of us don't have those "soft" skills, that can be important, when working in a team, or trying to establish relationships with other people.