Moreover it's not only westerners (or only men) who go teach over there. I see people teach English (and to lesser degree other languages) who are not white [diff people from Africa, South America, etc.,] who teach English --moreover, those teachers typically stay in a country a year or two and return home or go onto another country and region; inexplicably, there seem to be an overrepresentation of Canadians. Many of them take the job because it pays relatively better than the alternative back home.
Do _some_ suffer from some fetishism[1], I'm sure --but in my estimation, it's not many.
[1] Charisma Man speaks to the stereotypical western geek who suddenly finds himself attractive in a different culture trope.