For me, the problem with cars is that we have too damn many of them.
And making cars better is not gonna make there be fewer cars, at least not at scale. Yes, there might be some secondary effects from self-driving cars being available on-demand in a fleet, and then you don't need your own car anymore, so you're overall less likely to take a car except when you really need to. The same argument also applies pretty much the same way to Uber though, just with potentially with a slightly higher price tag because you have to pay the driver. And do we see decreased car ownership through market entry of Uber?
In the end, cars are a problem for many reasons. Pollution (at usage time for IC, at production for EV), noise, accidents, the unspeakable hell-scape that is car-centric suburbia, loss of public space for humans, you name it. Having to actually drive them is not one of the problems besides safety. There should be fewer cars in total. Which would also largely cover the safety issues.
So that's why the self-driving future for me is... kinda irrelevant really. Yes, the cars we will still have in the future might be cooler if they're self-driving, and I hope they are. But I don't get what all the fuss is about, really.
This is not to offend anyone here of course; I get it. It is cool tech.