Socially: Admitting you were wrong makes you look incompetent. If you were wrong then, why should anyone listen to you now?
Physiologically: Changing ingrained opinions on which many others are formed probably requires a good deal of brain re-wiring and may require solid plasticity. I'm unsure how much of a problem this is for the brain.
I guess there are a lot of other costs, but I can't come up with more.