I remember driving home in a massive rainstorm at night about two years ago with around 2 meter visibility and was going like 20mph because I could not see shit. I had less sensory data than a computer with extra vectors of vision beyond sight would have had, and my reaction time is a ton slower.
Then a year later I'm driving in icy conditions and count five cars that either off roaded or rear ended each other in the span of 15 minutes because of the slick surfaces. I imagine self driving cars would do a much better job slowing down and budgeting for potential slippage than impatient humans.
There is nothing really magical about our eyes that give us better clarity in awful driving conditions, and we don't have radar and GPS fed into our brains to give us a clue where the roads are supposed to be - we just rely on historical context and past driving experience on the same roads.
How many hours would it take a networked fleet of self driving vehicles to outdo my historical context for driving on any of the roads I've driven on for a decade? Two? Maybe three? You just need to get the tunable parameters right though some good old genetic algorithm work like what Google is doing now with its test fleet and while it would be impossible to guarantee perfect performance in every scenario (because inevitably an earthquake is going to make a self driving car crash where nobody could have prevented it) it just has to be better than us, and that has almost certainly already happened.