The point is is it doesn't matter how he got rich. He is rich and can afford to flee the higher tax bracket. You can argue it's wrong or immoral of him to do so but none of your arguments will induce him to stay and pay the tax. You try to squeeze the class with the most means and mobility and they just slip through your fingers.
Yes he is free and we are. He has the right to do so, and others have the right to criticize him for that.