Why do you think it's bad for the countries they are leaving that people can go and find work elsewhere and gain experience and skills (and most likely, return with these)?

There doesn't seem to be much of a downside to me.