The problem with tolls, and gas taxes and vehicle registrations for that matter, is that they disproportionally affect the poor. I, and many on HN might not give the marginal cost second thought, but for many it adds up.
I'd rather keep the tax and give them money, but that seems... difficult in the current political climate.