That's exactly correct. Laws are not a physical entity and therefore their existence is predicated entirely on collective agreement.
You might not care about the rules, but the rest of the world takes notice. This is how you break a world order carefully designed to further your own interests.