Of course, when you consider that an overhead road sign and a stopped semi trailer "look" the same to the systems involved, it's not surprising that they think that everything's OK.
There's also a lot of interesting research from Missy Cummings' Humans and Autonomy Lab at Duke. https://hal.pratt.duke.edu/
She's been very critical of a lot of self-driving systems that mostly work but still require drivers to pay attention. (She's also a former US Navy fighter pilot.)
I expect autopilot cars could follow similar regulations as aircraft: "if you want to keep your license, you can prove you've driven in manual mode for x hours every month", where x is enough to know how to control the car in an autopilot disengage.
[0] https://99percentinvisible.org/episode/children-of-the-magen...