Because the law is not clear as it is currently written. On one hand, the minimum safe altitude to operate an aircraft is 500ft. So it's pretty clear that anything above 500ft is considered a public thoroughfare.
The FAA claims to own and regulate all US airspace down to ground level. The FAA also says that drones must be operated below 400ft (clearly an effort to keep drones and manned aircraft safely separated). If we embrace this version of the law, then drones can operate from 0ft to 400ft with impunity over private land without any legal repercussions.
On the other hand, it is established law that a property owner is entitled to the full enjoyment of their property. In a famous case, United States vs Causby, military bombers were flying at an altitude of 83ft over Causby's house and chicken farm. The courts sided with Causby and established a precedent that a landowner does own some portion of the airspace over their land. However, it did not establish a specific altitude.
A bomber at 83ft was deemed to infringe on private property rights, but should a small drone at 83ft be judged in the same way? It's not clearly defined in law right now, that's why it needs to be tested in court. Or alternatively, the legislature needs to adjust the laws to make it clear.