I understand what you are getting at, but the issue is a lot more nuanced than that. What about a substance like LSD which has no known LD50 and has been proven to be less harmful than other "natural" drugs like alcohol and tobacco? At what point are heroin and cocaine no longer considered plant-derived?

In my opinion the only real solution is full legalization with better education and addiction management.