There's no ensuring either of:
a) It will react to everything that it needs to react to / not react to things that it shouldn't.
b) It will react in the proper way when it does react.
This is the problem.
Like I said if it were all automated drivers on the road, I think we'd have a really amazing safety record. But the problem is that with human drivers and automated drivers on the road, the human drivers are going to do all kinds of stupid shit, and how much of it will be reacted to properly? I don't know.
It seems to me most people on HN significantly underestimate the complexity of solving this problem of automated drivers alongside human ones.
Plus, I am also uncomfortable with training human drivers to just trust the computer and pay no attention to what's going on around them. I think that's the worst outcome of automated drivers.