Cocaine would have a similar issue as saffron. although to a much lesser extent. While it can be grown rather easily, one would need quite a few plants to make enough for a single recreational user.
The plant is a fantastic thing to have on its own, cocaine be damned. When we visited Peru it was a godsend on long hikes, like a good cup of coffee without any preparation.