You may find the theory of absolute and comparative advantage to be enlightening in its detail; but the broad conclusion is that even if country A is better than country B at everything, it will still make sense for A to focus on some things and B on other things.
For example inside the European Union it doesn't matter in which country a company is based, you have basically freedom of trade for goods and services. In Germany the medium age is 45 years, in Ireland it is 35 years; Population > 65 years is 20,6% vs.11,6%. Even if all other regulation in Germany + Ireland was identical, it seems unrealistic that Germany could sustain as low a tax rate, since the government has bigger expenses due to demographic issues alone. (Retirement benefits, medical)
If every company moved to Ireland because of the lower tax rate, what should be done with the old people in Germany?
If there was a hypothetical "ZeroTaxCountry", to which companies could declare their allegiance and pay no taxes at all. Would you consider that "A Good Thing" as well, since it seems to have all the benefits you alluded too?
As if it is good thing the company moving to a no tax country. From the point of view of the company's clients, it actually would, since it would mean that its products have the potential to be the cheapest of the market.
Will it completely do away with government liabilities? No. Australia too will face higher health care costs. But some of those costs will be defrayed by the superannuation and taxes levied on an economy that grew faster without the taxes than with them.
I am ambivalent about the Euro-US situation. On the one hand, it sucks that you face a period of painful adjustment to inescapable economic reality. On the other hand, your politicians have steadfastly refused to face up to those realities. As an Australian I find it annoying that profligate governments in Europe and the USA are hurting my prospects, even though here we've largely enjoyed fairly sensible economic policy for the past 25 years.