Why does exercising your right have consequences? If we go that way, why not just jail them? ("You have a right to choose, but if you do you're going to a quarantine facility")
Exercising your rights is fine until doing so risks the health and safety of others. Other people have rights too.