The effect you're talking about is not instant. If you get a lot of asylum seekers in a short time your GDP/capita will take a hit until they've been integrated into society and become a net positive.
And that period to get assimilated and become net positive might be a period of +- few decades which is an insanely long time in today's world of super fast moving money and economic conditions and 4 year hyper partisan election cycles.