Similarly we should favor even "bad" people being allowed to speak because norms change, often very quickly. 15 years ago it was entirely within the mainstream politics to not publicly support gay marriage. Now if you're against it you're labelled a homophobe. What views do you have today that might be decidedly distasteful in another decade? Do you know? Do any of us?
Suggesting that because you're expressing what are now mainstream views means you're reasonable and thus safe is to -- at least to me -- completely misunderstand the ideas behind equality under the law or the real goal of freedom of expression.
"Everyone has the right to freedom of expression. This right shall include freedom to hold opinions and to receive and impart information and ideas without interference by public authority and regardless of frontiers. This article shall not prevent States from requiring the licensing of broadcasting, television or cinema enterprises."
"The exercise of these freedoms, since it carries with it duties and responsibilities, may be subject to such formalities, conditions, restrictions or penalties as are prescribed by law and are necessary in a democratic society, in the interests of national security, territorial disorder or crime, for the protection of health or morals, for the protection of the reputation or rights of others, for preventing the disclosure of information received in confidence, or for maintaining the authority and impartiality of the judiciary."