To be honest, I don't know. This is an interesting problem. I do know that a lot of people get hooked on Oxycotin and then turn to heroin for a variety of reasons. Though if heroin was legal it could be manufactured in a sterile environment where you could probably get like 99% purity or something ridiculous like that. It's relatively easy to get a prescription for whatever you want. Especially in States like Florida that don't check if you're doctor shopping.
There are also legal drugs that have similar effects to things like Adderall. A lot of people don't know about them or use them because they haven't been researched as much and come in powder form.
At the very least I think that you shouldn't be put in prison for carrying pills without a prescription.
You might find this Vice article interesting. It talks about how Oxycotin is essentially legal heroin.
http://motherboard.vice.com/read/how-big-pharma-hooked-ameri...
I say we should take it slow when it comes to legalization. Perhaps start with things that are found in nature. Marijuana, psilocybin mushrooms, being legally able to harvest the opium from poppy seed plants, etc.