By this argument nobody owns anything because there is always some level of state authority that can make rules about what you’re allowed to do with it. What’s the fundamental difference between an HOA and a small local government?
You're right, and that's bad, too.
If what you're doing isn't affecting anyone else, you should be free to do it.