Also, it doesn't matter what economic system you're using, if your ratio of working people to non-working people decreases, your quality of life will also decrease.

Lastly, what I said doesn't require the population to grow, only to stay constant. If you want to reduce the population because it's somehow bad for the planet, you can do it gradually.