Apple innocently, and unknowingly[1], accept an illegal tax benefit. Apple lose the benefit of the illegal activity.
What's the difference? Caveat Emptor for both. Even if you want to consider them the innocent victim they don't get to keep the benefit of a crime.
[1] I'm less convinced it's unknowing here - Apple probably have a surfeit of international taxation experts and lawyers.