You don’t have to do anything to avoid flu vaccines. I “avoid” them because you have to waste precious time and I never get sick and I don’t like the experience of getting shots.
I did once calculate how many flu shots you'd have to get to save one human life based on heuristics and data on estimated length of infection chains and R0 for flu. I can't quite remember, but it's something like 100-people-years per life saved. So 10 people for 10 years might save a life by not infecting someone vulnerable. Very approximate.
If they guess right, and you get one, and you're exposed sufficiently to be infected, then they could make your infection less unpleasant (death is, after all, the worst case and unpleasant).
"I never get sick" is rolling dice. So is getting a flu shot, but in a different way. In the end, people still have to have the right to make those decisions for themselves (same weighing benefits against costs), with the understanding that if they get something bad enough (not that Ebola is that common in the US, or that there's a vaccine) they might not be savable and/or might be locked in a box to prevent risk to other people.
And keeping the life vest metaphor, we are not on dry land, we are on a calm sea but still on the water.