That's completely unfair, in this case. The vaccine in question was associated with an increase in deaths in some subgroups (vs control), and overall low effectiveness in the phase 3 clinical trials.
A 13% decrease in mortality in this study is actually quite good given what was expected, but it is in no way "fear mongering" to question the safety/efficacy balance, even now. For example, you'd likely never administer this vaccine outside of high-risk populations. The fact that the safety signals "went away" in this trial is likely more indicative of the baseline risk of the population than any change in the vaccine itself.
Where is this line? Hard to say, but just for the sake of argument: anyone suggesting that we add this to mandatory vaccination schedules in the US would be a total lunatic. Should it be widely used outside of the worst parts of Africa, where malnutrition and preventable childhood illness are rampant? Again, hard to say.
Vaccines are not automatically good, and it isn't "anti-vax fear mongering" to question a particular vaccine. We have to test them, and see if the rewards are greater than the risks in the populations where we intend to use them.