You could use the same logic to ban all sorts of things for adults. And many governments do, to everyone's detriment. Alcohol prohibition says hello.
It's exactly this type of generalized authoritarian philosophy that keeps the War on Drugs going strong.