I was thinking about your assertion that it's easy to solve, and why exactly I disagree with it so strongly on a base level. What am I basing this belief on?
And I figured it out. Driving games.
The AI in driving games like Gran Turismo has had more work than Google or any other company has done on theirs. And not only that, the AI in driving games has perfect information of the physics involved and the environment around them.
And those AIs are still fucking terrible when interacting with human players. Pack of AI driving around? Just fine. Add a human driver to the mix and it turns into a disaster.
This is why I am very concerned about automated driving in the real world alongside human drivers.