I didn't downvote you and don't like if someone does it without leaving criticism. That said, I understand the objection to your reasoning very well and maybe people refrain from answering because the pitfalls of your model for speech are trivial. It comes down to who get the power to define truth. That is not a problem if anyone is allowed to leave their opinion. There will be people that abuse that right and that is the cost of it.
And we have seen intentional lying which I believe was a great mistake in current times when information moves that fast. Because the lie will come to light at some point anyway.