Right, but do you want to use
threat of punishment to enforce your personal desires? Do you want to live in a society where that's a thing that people can do? If society were headed that way, wouldn't even
you want to talk about it? I doubt you'd want to live in the kind of society you want to build.
Assuming you think coercion is a bad idea, your only tool left is discussion and consensus-building about rules. In other words, politics.
(To be fair, I understand the underlying sentiment: I, too, would like to live in a world where my personal desires were somehow the law of the land in such a way that everybody else were also happy with them. But after some long thought (and some good literature) I think that really falls in the "be careful what you wish for" category.)