If they employ people in Norway you can tax them on that. If they sell in Norway products or services you can tax them on that. If they purchase infrastructure you can tax them on that. If they own any infrastructure in Norway you can tax the ownership. If they rent anything, you can tax renting. If they borrow Norwegian money, you can tax that. If they lend to Norwegians you can tax that.
That's a lot of benefit. Pretty much all of the benefit of hosting any company, domestic or foreign in Norway if you don't tax the capital itself.
What you can't tax the companies on is profit because it's trivially concealable.
It's even better if they are foreign as they have lower political capital because they can't cry their tears out to the Norwegians to have lower taxes.
Pushing rich people out of the country and taxing them along the way is the best thing that might happen. And the money collected can be reinvested into infrastructure and consumers so that foreign companies have a reason to do stuff there.