Passengers won't be anonymous and Uber already has reputation system. Also you can already rent a car, and rented cars are usually not vandalized.
Driverless rental vehicles will very quickly look like the back of public buses. "Dave {hearts} Christina" inscribed on every surface.