Now, my experience is not representative as a whole, but it's generally what fuels my thoughts on this subject. If this is the story I hear quite frequently, why would I want these drugs to be introduced legally into people's lives? That's why I've always had issues understanding people pushing for legalization.
I understand how it can come across as puritanical ("I know what's best for you"). However, when all data suggests that engaging in drug use almost universally results in poverty, why would we as a society want to unleash such a thing upon people? It's for the betterment of humanity that life-ruining drugs are illegal.
At least those are my thoughts.