There is no right to protection from infectious disease. It appears nowhere in the US Constitution. There was never any valid moral or legal justification for restricting the 1st Amendment right of freedom of assembly during the pandemic.
Well, that is not quite true at the State level. There are a number of States who have implemented laws that punish transmission of HIV/STDs knowingly. I'll concede there doesn't exist anything at the Federal level that I am aware of.
I would note that while the US Constitution is a valid authority with regard to legal justification (in the US!), it is very much not with regard to moral justification.