I feel like people get too absolutist about this. At the end of the day, people should be free to do what they want as long as it doesn't interfere with anyone else's freedom to do what they want (aka do unto others, etc).

The problem with "let people do literally whatever they want" with their property is that it infringes on my freedom to live happily/healthily on my property.

If my neighbors blast music until the early hours of the morning and they don't turn it down when asked politely, is it "reprehensible" for me to call the police to enforce my village's noise ordinances? What if they're burning refuse and it spews over into my yard and ventilation? Or if they have an uncovered fire pit close to the property line?

That's not even getting into the long term effects on the community, like if people store or dispose of hazardous waste on their property (we all share the same water table!).

I don't think it's "fundamentally reprehensible." It's part of living in a free society that balances the rights of one against the rights of all.