If you don't have population growth, you can't replace the old generation fast enough.
Eventually your retirement system will crumble. Not tomorrow, not next year, but maybe a couple decades from now. And it's not something you can fix in a year or two.