It depends; if you are paying taxes to the government of the country you reside in (say, Australia), the US has a reciprocal agreement with them, and you are not charged tax two different times on your income.

On a company level, this seems to translate into "we have super low local tax rates, build companies and campuses here to boost our local economy!" (see: Ireland).