I think some of that difficulty is because we mostly build up driving intuition on clear roads. An auto-driver will have relatively objective heuristics to evaluate road conditions, which is where humans make a lot of their mistakes (that is, humans frequently just fail to realize that the road is slippery).