Surely by that logic we should give up trying to tax the rich altogether.
The rich will always try to dodge taxes, but we can make it harder, say for example by spreading it out over different forms of income and consumption.
We should also be looking at the international stage to diminish the value of tax havens, offshore companies etc. I think many countries are beginning to realise that ever lower taxation rates are a race to the bottom.