Unfortunately, sometimes, freedom is a zero-sum game. I'd rather be free to sleep comfortably at night, than being "freee tooo parrtyyyy, broooo". And those who complain about this are usually the kind of people I wouldn't want near my house.
I love to have the freedom to live in a regulated neighborhood with like-minded people and those who don't like it are free as well to go buy a house literally anywhere else in the world.