Another option could be to charge a reasonable tax rate and make it as easy as possible to pay. This would reduce incentives to find ways to avoid tax, as those alternatives have costs as well. Wealthy people are the most mobile in society.
I think it's good that countries compete on things like tax rates and good governance. No person or company should be beholden to any one government.