Failing on the last 2% (or whatever small number we want to set) isn't a shortcoming of deep learning: it's a shortcoming of all prior knowledge systems. Humans included.
And the barrier to surpassing that problem has been hardware (now approaching solving) and calendar- & person-time.
The problem with 1970s AI (ingnoring hardware) isn't that we couldn't build useful AI, but that we couldn't afford to build useful AI in most domains.
Calendar time costs money. People time costs money.
Deep learning and derivates finally provide a solution where we can substitute machine time and data volume for calendar and people time. As a result, we can afford to do things in domains we couldn't before.