It's entirely possible that some of those haters are Caucasian-Americans who don't consider Asian-Americans real Americans.
People outside of North America just assume that Americans come in two colors: white and black. And why wouldn't they? That's all the American entertainment industry shows.
Based on Just Italy?