But on the other hand, gambling can bring serious social ills. Gambling isn't banned in most places because we don't want you to risk $5 to win $10, it's banned because of addiction, associations with crime, heavier impact on the poor, etc.
I don't have a stance on the issue per se, but I do think there are strong arguments against unrestricted gambling. Unlike the drug war, at least, the people in hot water are the people making money, not their customers.