Look. I'm not even necessarily trying to argue that we should have more immigration. But, only one of the below statements can be true:
• The US has too few people.
• The US has too many people.
If the former, we should increase immigration beyond whatever the current levels are.
If the latter, population decline obviously isn't a concern.
Which of these universes do we live in? It can't be both.