The problem with the homeless isn't how it offends your senses.
"I'm not all that likely to be accosted, but if I ever am, it will be a big deal, so navigating those places is nerve-wracking because my threat-detection is constantly dialed up."
Have you ever thought that being this worried about threats is something you're partially responsible for?