The bullet has to connect with the drone, they can move very fast in a number of directions.

One bullet may not be enough unless it hit the flight computer.

When the navy shoots bullets at a incoming projectile, they pretty much create a wall of lead (Phalanx).

Even if you could shoot one bullet, one bullet could go through it and into the window of a high rise office building.