No need to worry, plenty of people exist. Every contrived "benefit" of fertility is actually a benefit of having a sufficiently large working population, not of rotely making new babies. Not mentioned in this thought exercise is the concept of immigration, the tried and true method of ensuring a sufficient working age population as famously exemplified by the greatest economy the world has ever known.
It's a particularly important distinction since those wealthy nations that manage to score well on this metric tend to skew towards theocracy. And those that do not tend to share the common characteristic of having large immigrant populations already, which fuel their higher birth rates.