I suspect that the we won't jump from fully manual cars to fully automatic cars. It will likely be similar to the auto-park function: we'll see more and more cases where automation is available at the request of the driver.

As car makers add these new functions, we'll start to get an idea of how liability will work with them. Some driver is going to get into an accident using this and then claim that the automation made a mistake. Should result in a very interesting trial.

It might end up taking a very long time to have the manual controls removed simply due to liability: as long as you can control it, it's your responsibility. Without the controls, it much easier to argue that Ford/GM/Toyata/Google/etc is really at fault for the accident.