If no one paid taxes, then the governments capacity to do bad things would certainly go down. However, then there also probably would be no government and everyone would be worse off.
I'm sure lots of tax money is wasted, or used for bad things, but also a lot of good as well. Roads, police (that keep the peace), firefighters, education, foreign aid, etc.