This doesn't seem reasonable. For one thing, honey bees are smaller and weaker than people, and a poison that affected both uniformly should be more damaging to the weaker species. For another, honey bees are very different from humans, and there may be poisons that attack the bees without attacking any part of humans.
I agree and understand that ecological damage is bad, and that many real poisons do too much incidental damage to people to be considered "safe", but it seems foolish to base a persuasive argument like this on such faulty reasoning.