That is not accurate. Downvotes are for comments that negatively contribute to the conversation. One way a comment can negatively contribute is by failing to honor protocol, but it is not the only way. Even simply extraneous comments like lazy jokes probably should be and conventially are downvoted on Hacker News. Promoting pseudoscience definitely doesn't seem like a very good contribution to me.