Whilst I do understand your point it's hard to argue that a drone would fare any better against a 50cal round. They are infamously, very fragile.
Bigger drones would be slower and easier to spot, but even then - if you're not ready and waiting it'll be gone before you have time to react. The only consistent solution for anti-drone warfare is automated. Or nets.