It seems like the easy answer is to kick human drivers off the road, right? That will eliminate a great deal of the unpredictability. Start with a small section of a city, and if the results are good, people will want to expand it.
Cars already own non-urban everything, and can stay there. We need to be moving in the other direction. How's that ban on cars on Market St. going?