Because you forgot to look at how many westerners move to other countries, too, and how many people in those countries move to western countries. You're asking a question based on an assumption that doesn't hold.
I have nothing against the country or anything I’m just curious why Japan is so popular. Was it historical or something?