Someone not taking the vaccine is imposing consequences on everyone else around them and society at large, raising the risk of immune-escape variants, raising transmission risk to people that can't take it for medical reasons, raising the risk even for vaccine-protected people by defeating herd immunity (J&J gives 72% protection, so you're running a fair risk if the rest of society isn't vaccinated.)
The consequences you complain of are pretty much just pricing in those externalities to the decision.