A marriage is a private contract between consenting parties just like any other. The state should not get involved.
If you don't want public recognition of your marriage, I'm sure you could write up some private contracts, but it won't confer all of the same rights that a state-recognized marriage gets.