A lot of the bad aspects of the stress response come from prolonged periods of not being able to do anything about it. If your village is raided, and you escape unharmed, you will be
very stressed for a short period of time, but generally return to your baseline quickly after that. That's normal. That's what "stress" is for.
The modern world has the ability to stress you out over things you can do nothing about (or at least, not very directly and quickly), for long periods of time. Sit down and watch three hours a day for a week of whichever news channel pisses you off the most if you want to see. Some of you reading this already do that, so you may not even notice how pointlessly stressed that makes you because that's how you live. It also has a bunch of other humans who find it advantageous to stress you out that way and bend a lot of time and effort to the task of continually stressing you out, because they prefer that you not be able to carefully think about things but that you react less thoughtfully. You spend more money that way, among other effects.
Past life would spike the stress levels more often, sure, but it generally lacks the low-grade continual stress you can't do anything about. The exceptions that leap to mind (sieges! famine!) would generally be exactly that, exceptions. And in those cases... I'm sure the continual stress of sieges and famines wouldn't be good for them, either!