Call me crazy but why not consider ways to let someone remote drive the vehicle? I'm sure there are all sorts of corner cases (bad signal for one) but it's done all the time with drones.
https://www.wired.com/2017/01/nissans-self-driving-teleopera...
Lot of trust in that individual when they too don’t get killed if the car crashes. Also hope you never have packet loss!!! There’s also that pesky speed of light restrictions on low latency, etc.
It's probably not practical but if it were it might make for decent cubicle work for unskilled labor.
A VR service for Truckers sold by Uber/Lyft could be a thing for the millions of truck drivers to be out of work in the not too distant future.
Have another lyft driver drop them off at your car before you leave for work in the morning