Why not have the passenger be the one in the driver's seat ready to take over in an emergency?
I definitely see a place for share pool cars that deliver themselves to you when you need them and return autonomously when you are done, but maybe not Uber?