The common argument to raised concerns of drones buzzing about is "well, we have cars and delivery trucks!" That doesn't quite sit well with me because we have designated specific areas to the use of automobiles. It's easy to stay off the road. We can consciously stay out of harm's way, even if it's an asshole driving recklessly.
How is this accomplished with drones? How is the airspace structured in a way where drones are in designated areas that either avoid or are avoided by humans? How do you prevent an asshole piloting a rogue drone from dropping a heavy item on someone in a balcony? One can make the argument that these concerns also apply to planes, but I'm assuming both the airspace and ownership of planes are heavily regulated and monitored. Will we need a similar system to manage drone use?