From my experience living in a different city, the legitimate complaints about it from people who actually live there tend to be specific, like "the 34 has been skipping routes this month and the park by the Firehouse Subs is still closed for construction."
Whereas the complaints that come from outsiders are vague culture war talking points that transparently originate from fear/outrage media. Vague and generic driveby comments about how it's wholly unsafe and going to hell.
The cities I've lived in or visited frequently, the locals who aren't looking for trouble feel safe and don't find it difficult or burdensome to avoid unsafe areas/behaviors.