I was already in a magnet school at the time, in the gifted program, but it was in a small ethnically homogeneous town.
The things that do make it better: (1) moving to a larger, more diverse city / population center, (2) not being the only Asian kid in a class (better if you're > 5% because having only 2-3 in a class still 'others' you).