In the urban zone, there will be competition for scarce roadway as businesses no longer paying a driver, go increasingly JIT, and elite commuters value door to door service. No city gov't will be able to resist the right to tax per mile, tax rush hour surge charges, and tax luxury idle vehicles. This will push the middle and lower market into on demand rentals. And without the driver as an informal superintendent of the vehicle, there will be a very annoying problem of getting into a car that a gross person knew they were never going to be in again. Enter the eye in the sky. Except for customer with a 4-star reputation or higher. This will create a race to the bottom for anyone who can't or won't establish reputation to get passage on an autonomous vehicle.
I think we can't even fully contemplate yet how alienating and de-humanizing self-driving cars are going to large parts of our society, and how amazing they're going to be for others.