Your total scope is about 40,000 road deaths. Off the top 1/6 of those are pedestrians most often hit at night. Another 1/6 is motorcycles. A little more than 1/2 are those who are drunk or otherwise impaired. Around a 1/3 involve someone under the age of 24 and male.
People presume that driving is exceptionally dangerous. If you actually examine the data you realize it's one of the safest things we do, given the _trillions_ of miles that are driven every year in the US alone.
From this perspective, it's not at all clear that greater levels of automation are going to improve anything. From the history of introduction into airlines, it will initially make travel _less safe_ until drivers are retrained to use the new systems in a way that doesn't enhance risk. These will often be non-intuitive lessons.
If you put a human in a machine also designed by a human and use it around other humans, you will never eliminate human factors.