You also don't want most people to be driving EVs, because then it quickly becomes a situation like bikes are with last mile transport: if everyone used them, they wouldn't work so well, but so long as only a few people are using them it works great for you. If everyone brought a bike on the train we'd have to redesign trains to be far longer and lengthen underground stations to match; right now its fine because its only maybe 2-3 people per train car with a bike in my experience, but if that changes the fixes are expensive.
Likewise with EV chargers, if we see mass adoption, we'd have to foot the bill to turn every basically zero cost spit of pavement people park on into dedicated charging infrastructure. I'm assuming a municipal charger will have to be substantially more rugged and able to handle more abuse than your average home charger installation. Estimates on the internet vary for what a l2 charger costs, lets say its $10000 for one fit for a public parking spot. That would put the cost to convert the 6 million parking spots in Los Angeles at $60 billion. Sure that's probably not sound math, but it doesn't seem cheap, especially factoring in ongoing maintenance and replacement.