On top of the social side of things, the roads are not in great shape in northern climates and many of the visual cues that we use to drive can be missing or very hard to see for many miles. Striping delineating the edge of the road often gets worn away over the course of a few years and doesn't get re-painted for a few more. Some major roads connecting two towns may not even have a paved shoulder, just 24 feet of asphalt with a stripe down the middle. (For reference, 12 foot lanes with 4 foot shoulders are the general norm for this part of the US.) All of this and I have still yet to touch on weather.
I look forward to self driving cars. However, I don't think that they are going to solve many of our traffic issues outside of urban cores. For me, the incremental steps to reach self driving will result in fewer injuries and fatalities on our roadways, and that is a win.