Not really, because there is no balance. Way more harm is done in the name of protecting people than is done by allowing freedoms.
The rest of your argument is predicated upon there being some kind of balance. There isn't one.
You don't need to look any further than The War on Drugs to see this. It's already been scientifically proven that letting people do what they want is far better for society. The only people who work to keep drugs illegal are those who benefit from them being illegal. Same thing here.
There's not much more to say about this. You're never going to convince me that removing freedom is better for society when people will always have the choice to remove it for themselves by making the right choices about who to associate with or who to do business with.