I agree it's not a great metaphor, but my point is that "let everyone make their own decisions" isn't some end-all argument. All rules and laws in society are about not letting people do whatever they want for the benefit of society at large.
Also you're trying to appeal to emotion by framing mask wearing as some sort of punishment ("revoking" people's drivers licenses) vs a precaution (like wearing a seatbelt... or not driving drunk). Furthermore, people caught drunk driving DO get their licenses taken away.