For thousands of years people have munched coca leaves and made teas out of that and there has been no problems whatsoever.
The problem started when someone took a bunch of those leaves, mixed them with a bunch of chemicals to create a highly concentrated substance.