Granted, sudden changes to the environment would kill off the less fit individuals. So I'll change my argument a bit:
Suppose you've overcome infant mortality, and have also solved the problem of adult mortality, so all subsequent people are immortal. Suppose moreover that young adults insist on having more than zero children (that's likely to continue, you'll agree). Now you've got a population that won't stop growing. Resources are finite, and there will be mass starvation.
What are your options in such a scenario? Should you kill off old people, kill off young people, or prevent all future babies?
Suppose you prevent all future babies. Then you end up with no more sex, no more genetic variability, and now the whole species might be susceptible to a sudden environmental change.
So my argument is that old people must die to make room for genetically-different young people. Without natural death, there will be less room for evolutionary adaptation.