Society has a lot of tolerance for stupid people. In normal times their stupidity isn’t spreading an infectious disease that’s killing thousands of people every day in the US alone (3,764 people died in the US from Covid yesterday)
We as a society have tremendous tolerance for these people (at least in the US), who are less "stupid" and more some combination of "dangerously selfish" and "mentally ill". Many such people still have driver's licenses, and you only really get punished for a DWI when you actually do kill or injure somebody.
So if that is the standard society has, we should apply it to COVID-19 to be consistent. If someone dies of a Covid case that is traceable to your own negligence (e.g. going to work with symptoms and no mask), you should be held liable for manslaughter.
It's not some high moral ground of freedom thumping people. This is what our grandfathers fought for.