I look at it the same as a car. You can't just drive anywhere. So why is a drone much different. At least under the height for a commercial license.
I highly suspect that the space above a private property up to the commercial line will be considered part of that's person's space. After that it will be like most everything else, there will be places you can and can't fly, just like there are places you can drive a car, take a walk, and so on.
You can fly unmanned balloons, helicopters, Macross robots... whatever. Essentially the FAA has no jurisdiction below 700 feet ourside controlled zones, so if you avoid those you can basically fly anywhere you want.