Well some plants are just poisonous and not fit for consumption. Specifically adding poison is a risk. And that makes it a tradeoff. But add to that these plants did not need to survive on their on in nature for millions of years. Instead are cultivated/protected very specifically.

The eu judgement is not the result of a public scare, I don't think.