It would be financially-irresponsible not to.
Wanting to be taxed higher and avoiding being taxed are not mutually-exclusive.
Like wearing a helmet: I want laws to be passed to make illegal to not wear it, but since it's not illegal, I sometimes won't wear it.
I want everyone to be taxed fairly and equally, but since it's not like that, I'm going to keep as much money as I can.