The common law has been developing for hundreds of years. It is an extraordinary institution and an important part of Western traditions.
At its best, the common law has allowed a finely balanced rule to develop - not in a vacuum, but incrementally and iteratively proven in thousands of real-world cases.
Some of the best minds of our civilizations have tussled over these guidelines, and the more lawsuits that have occurred, the better-developed that area of law, in general.
The United States' approach to the common law of libel and defamation has been strongly shaped by the First Amendment - and that Amendment was not nearly as strong a century ago, remember. It has been accorded more respect and power over time, and that is a wonderful thing.
All of this to say: you're ignoring the entire edifice of law concerning free speech, libel, and defamation. The balance of free speech vs libel and defamation is a defining feature of the success of our society, not its failure.