You are right that one problem is possibly humans don't drive with their heads fixed in place, they move their neck and constantly adjust viewing angles.

w.r.t. the super computer point, AI systems have been able to out perform humans for specialized tasks for a while.