And what sort of people might that be?
I think autonomous cars will also cause problems because currently if nobody is driving it, it has to stay parked. When it becomes autonomous, you can send it on errands or even to just drive around and try to grab a better parking spot etc. It will mean more humanless cars filling up roads, leading to a feeling of an inhuman ghost town.
I recall visiting Dubai in 2006 or so and remarking to my family at that time of this striking inhumanity of that place. Just automobiles everywhere. One might have imagined one was in the world where Transformers was invented and the humans had arrived as aliens to a machine planet.
The only places that really feel human are those which have people walking around. The cars have high utility in transporting people to those places but having human drivers in large numbers of cars has never made a locality feel non-ghost-town like.
In reality, the illegal e-motorbikes and scooters cause less issues than cars, but they are visible and it's become popular to demonise them, despite them reducing congestion and being far less dangerous in collisions and producing far less pollution (e.g. tyre wear particulates).