Yes this is an important point that is usually overlooked in arguments about taxing externalities. e.g. GS makes off with bank from introducing carbon tax