Property is absolutely based on consensus, property beyond anything you control with your direct person is very much one of those polite fictions society collectively agrees to, like money and laws.
If the large majority of people, for whatever reason, decided to stop agreeing, such fictions would cease to exist.