China disagrees. They're still growing, in spite of a bloody ruthless birth control system (though I seem to remember that they've loosened it a bit, not sure).
Also, the Romans died out because they fell into decadence, which is exactly what the west is doing right now.