> I imagine this is actually a pretty tough problem to solve.... road marking change dramatically within a few feet sometimes.... most of the residential streets in the historic area I live in have no markings at all but its also an area where markings, composition of road materials etc are subject to change QUICKLY from street to street.
I wonder if they could do something like a "Kalman filter" to address this. If you're driving forward on a road, the driving program shouldn't re-derive the scene from moment to moment, but it should update its existing picture with new data. If all the sudden its long-range sensors get jammed, it should be able use its last picture + dead reckoning for at least a little bit (though only for trying to stop in safe(r) position or avoiding entering a more dangerous area).
It certainly shouldn't move into oncoming traffic, like this Tesla did.
That's exactly what I would do as a human driver (say if all the sudden I'm in a white-out). I know where I am on the road and where the nearby cars were, so I have maybe 10 seconds to try to move off to the side and stop, even if I'm blinded.