The freedom allowing people to make those types of decisions trumps that argument.
Where would you draw the line and determine what we should "let" people do with their own possessions?
So you would not let a person gamble their house on a crap shoot? How about their car? Their watch? $5?