My problem with that attitude is that it's not humble. Not in a false, pretending-to-not-be-good way, but systematically not acknowledging that you may be wrong. Say what you think is correct, but always conduct yourself knowing you may be wrong.
Wrong beliefs are often dangerous (an extreme case would be believing that prayers are better than western medicine at curing most illnesses). So your duty is to convince the other person, or at least control the damage.
Now of course, if you do see that super-crushing evidence against your previously strongly held belief, then your duty is to change your mind. The most difficult part here is correctly assessing the weight of each piece evidence, and how they interact.