Society is just a bunch of people. They can agree about something among themselves, but they can't force that agreement on others.
Imagine you are in a bar with friends, and they agreed, that you should pay the bill. Can they collect your money by force? Clearly the answer is no.