No? If other people didn't exist then there is nothing to disallow. We are talking about how people will go to meetings to try to veto building proposals.
I am not sure I understand. In your view, if I live in the middle of nowhere, with no people around me, then I don't have the right to disallow people into my home because nobody is coming? How is it different from me living in the center of NYC and not allowing people into my home, the result is the same - people are not coming into my home, are they?
In your middle of nowhere example, you didn't disallow anyone anything.