There's a difference between reasonable and pedantic. To say "going through that neighborhood is perfectly safe", doesn't mean you're not aware of there ever being crimes there.
So yeah, if you would try something like that within the context of a very contested issue, I would definitely assume you're clandestinely trying to sabotage the discussion.