HN I'd actually say has better discourse than just about anywhere else online, as hackers, more often than not, are open to revising their opinions and ideas based on objective fact. After all, you wouldn't get terribly far coding were you to doggedly retain irrational beliefs about the subject matter you're engaging in.
As to downvoting - not so much, I don't think. HN's moderation system is pretty effective in ensuring that poor voters and contributors don't get to continue doing so.
The SNR here is still much better than, say, reddit.
Finally, the argument of "we shouldn't talk about this, because it's polarising" is a dangerous one, as ultimately it serves only to stifle discourse.