You are not spending the first 20 NOK of your sale, you are just collecting them from the customer. If VAT was 0% then your sale would be for 80 NOK.
It's not my money, but I still have to bill for it and pay it. The customer doesn't get a better product or service because of it.