One of the real challenges of these systems is that even a very good system only needs to lose confidence in some object for a very short period of time for the system to lose confidence in its navigation and return control to the user. The easy way to get around that issue is to categorize objects and then just ignore them out of the context you expect them to appear in -- which is how Tesla managed to kill a pedestrian walking their bicycle across the road.