No, you wouldn't. The thing is that all that top wealth is managed by a group of accountants and lawyers. Highly professional accountants and lawyers. (My friend is an accountant here in Silicon Valley who manages wealth for billionaires in a large accounting firm. He describes me some ways how they manage wealth.) So these people's role role, their only role, is wealth preservation, meaning tax minimization and avoidance. They know all the laws, rules and regulations, and they have fiduciary duty to manage the wealth efficiently and conservatively. Hence they will go to tax heavens and offshore, if needed.