> the problem is that it's always the other guy or some corporation who's being unfair
Self-interest doesn't make someone incorrect. Isn't that one of the tenets of libertarianism? Also, it's not like the free market is some kind of objective tie-breaker. Outcomes in a market are highly sensitive to regulatory conditions. Before you suggest doing away with as many regulations as possible, consider that "regulatory conditions" can include things as basic as the definition of property, which is a problem that cannot be dodged in even the most libertarian of societies. Does society have a notion of intellectual property? If not, how do you propose to fund drug development? Can infrastructure be privately owned? If so, how do you stop natural monopolies from destroying competition? Should a company be allowed to buy up property surrounding your house and then ransom travel through their property off for all you are worth plus all you can borrow? The list goes on.
> I'd say it is completely unfair that a government takes a portion of my income
Whoa, there! You're assuming what you set out to prove: that the government's slice was yours to begin with. The social contract comes as a bundle deal. You "sign away" your tax dollars by being part of a society that provides services to you. Obviously no explicit consent is involved, but that's because it can't be involved. Voting is the best compromise we've been able to come up with.
Even in a libertarian society, government provides one very important service that disproportionately benefits the rich: enforcement of property law.
> Are people in the government somehow know the ultimate truth?
No, the existence of government is a compromise between a free market that has flaws and a system of absolute control that also has flaws. We delegate responsibility for the areas where one system is hopelessly flawed to the other system (which merely has to do a better job, not a flawless job). Adam Smith himself acknowledged that the free market is not suited to provide certain services (police, infrastructure, military, etc). The goverment isn't aware of any "ultimate truth" here, but they aren't going to pull the whole "box you in and take all your money" stunt either.