Its no different than hunting, where you already have to get a license and ask for permission before going on to private property.
Hunting is actually taking resources from someone's property. A drone flying over your property doesn't harm you at all. Airplanes don't have to get permission from me to fly overhead. They can even legally take photos of my property if they want.
Just the other day some recreational pilot crashed in a field near me, and he didn't have to have a flight plan or anything. You don't even need a pilots license if it's something like an ultralight. Drones are vastly safety than that.
Until it falls on your head. Not to mention the gross privacy violations that this allows.
But the point is that a small drone is orders of magnitude less dangerous than even the smallest aircraft. The regulations should reflect that and be far less strict on them, not more. I'm ok with height restrictions or regulations against hovering outside of someones window. That's probably already illegal under peeping tom laws anyway. If it's not it should be.
But banning them entirely is just a knee jerk fear to new technology. This has potentially immense utility for delivery and other applications, just give it a chance. Despite all the media fear mongering the number of people killed by drones is negligible after more than 5 years.
Maybe you can't. And that's just fine?