A good number of idiots do fly 'only above [their] own property'. The issue is that they fly much higher than 400' above their property.

That's the problem. If people had only flown at designated places (RC parks ie), this would never have happened.