Agreed on the latency with the driver.

Let's also think about the diminishing skills that we'll experience once automation takes over the majority of our driving. Imagine taking 3-4 weeks off from driving and then being asked to take the wheel under a difficult circumstance.