For me, the thing that killed voice commands had nothing to do with speech technology. It was latency and error handling.
At the start of my morning commute, I would say, "Ok Google, navigate to work".
Often, this would fail because I was in the network limbo area outside my house, where my phone struggles to transition from home WiFi to data.
Worst of all: The failure would be horribly slow. I would have to drive for another 30s before my phone realized, yes, we are really out of WiFi range now. And the voice command wouldn't be auto-retried. I would have to tell my phone again. It didn't remember.
I added one-touch "Home" and "Work" Google Maps widgets to my home screen and never looked back.
As an engineer, I realize why this is a tricky problem. As a consumer, I want it to "just work".