I have to add that I hear this premise expressed quite often from people peddling low-evidence medical advice and not-quite-believable conspiracy, who try to give credence to their theory by pointing out that the people-you-don't-like disagree with them, no matter what the grounds of disagreement actually are. (I've seen people refer to this thought pattern as the "Galileo fallacy", although we also shouldn't let these named fallacies turn us away from actual interesting ideas just because the public disagrees, too. It's a balance.)