But now you're not talking about a "right", but merely a biological imperative. Nothing that separates humans from, say, spiders. And then your "natural right" to property extends no farther than your ability to defend it from someone bigger and meaner than you.
I can shoot you, and then your land becomes mine, by "natural right". Is this really the hill you want to die on?