Maybe if they fly them high enough? Or maybe wind would become a problem.

Also, dedicated drone corridors that are over roads or uninhabited areas, so at least only cars would be hit in case one of them drops out of the sky.