The issue is any antibiotic that could be used to cure humans should be used for nothing but curing humans. Every use of it rolls the dice that the bacteria will evolve an immunity to that drug. There isn't any "safe" use. Bacteria will eventually evolve and we can only reduce the amount of evolutionary pressure being applied.
So in short, yes the problem is giving it to animals.