2 issues.
As stated in another comment, most of the income taxes / import taxes etc affect a tiny fraction of the population. Not really a huge voter base there. Influential and disproportionately powerful - but not enough to swing elections I think.
Also these taxes fund a huge number of programs that will need to be cut down or cancelled which will affect a lot of people (who don't necessarily make enough to pay income taxes). Not really something that any government can do in good conscience if they want to hold power.