I imagine driving a self driving car is like watching someone else driving as a passenger:
"oh look, a railroad crossing with a train crossing"
"we're getting close to the crossing, surely he noticed the train"
"why aren't we slowing down? oh crap he falls asleep at the wheel"
*grab the wheel and steer off the road*
As long as self driving cars require constant supervision, I think this kind of accidents will keep happening. Drivers will have reduced reaction time when they're not actively driving the car.