> But no matter how wealthy someone is, they can always point to the more-rich and say those people are the problem and should be taxed, not themselves.

This is obviously untrue. There isn't an infinite number of people wealthier than Gates or the Waltons or the Rothschilds. At some point there is no one further up the economic ladder in whatever location you're talking about.