The point being made is that if you consider permitting holistically by attributing to it all costs that wouldn't exist if permitting didn't exist-- the cost is much greater.
When people complain about the costs of permitting they mean the these total costs, not e.g. some 1% of total project costs filing fee or whatnot.