There are plenty of rail-based transports that have no driver (Vancouver's SkyTrain is the largest iirc). They seems to get by without being ripped apart by passengers.
I imagine though that it'll just be something you can report when it comes along, then it gets sent off for cleaning, they pull up its recent rides, and send you a different car.