Like any risk, you also need to consider the impact of getting it wrong. If an audio assistant gives you the wrong answer to the population of your hometown, no big deal. But if your car thinks everything is okay and drives you into a stationary fire truck on the shoulder of a freeway when you are travelling at 70mph, the downside of that edge case is infinitely worse.
Sure, humans can make these mistakes, too. But the fact is that your notional world where computers are able to make smarter decisions than humans about how to drive doesn't actually exist. No one has figured out how to make it work. And they won't anytime soon. They've solved all the easy parts. But it turns out there's a lot more involved in driving than all the billions of dollars poured into the problem so far can figure out.