TGN1412 is a good example. This drug turned out to provoke the immune system in an extreme way. What if it had been tested first on cancer patients and, even with the life-threatening side effects, it worked as a cancer immunotherapy? Then we would be able to work on dosing or mitigation. Instead, the company folded, the research was abandoned and we'll probably never know.
And further, it's a cold calculation but instead of having healthy lives ruined you would have terminally ill patients die slightly sooner.