I had two great grandmothers that lost the majority of their children as babies/toddlers.
I think a lot of people are not accounting for the costs of risks during that time. If everything went well, the rain was on time, no other nations attacked, no one fell ill, there were no birthing complications, then life was okay. But nature usually throws a few curveballs.