These are the sorts of things humans struggle with too. It could be argued that we, also, don't have one neural net that does all these things but rather a variety of specialised brain regions. It would then make sense that a computer might run specialised programs to deal with different tasks.
Anyway, self driving cars and bicycling can be fixed with a simple engineering solution: separate the two with barriers. This is what we should do anyway.
As someone who had their bike destroyed in a high speed car vs. bicycle collision, and was lucky to walk away with a broken thumb and sprained ankle: cycling on roads is insane.