This also double screws you due to crowding. When do people drive to work? Same time you do. When do people go to USPS? Same lunch time you do. What time can you go to the fancy restaurant? Same Friday night everyone else does. Traffic, parks, grocery stores are all crowded at the exact same time.
In the DC Metro region we have congestion-based tolls and it seems like it has shifted commuting times a bit, but it also causes a lot more congestion on the secondary traffic arteries.
Thankfully I think the pandemics has sort of disrupted employer ideas about flexibility. It's clear more workplaces are offering remote work and flexible schedules and I think that change will last.
Then the tax is not high enough. There exists a number where people will say this job isn’t worth it. And you can even toll all roads since license plate scanners are relatively cheap.
Right now, the unpaid externalized costs of everyone driving to work at peak times is diffused across so many people’s inconvenience and time sitting in congestion. Not to mention the environmental costs of making a road 8 lanes wide for 4 hours of traffic out of the whole day.