And let's not forget the accomplishments of the other pioneers: Lainnainmaa, the inventor of backpropagation 1970. Ivakhnenko, the inventor of the first deep learning networks that learn internal representations 1965. Fukushima, the inventor of the convolutional neural network architecture 1979. Waibel, who combined backpropagation with convolutions 1987. They are prominently mentioned in the critique in Sec. XII, XIX, XXI, XVIII, XX and others.
1. Convnet (Lecun) 2. LSTM (Schmidhuber) 3. Scaling up the convnet to win ILSVRC (Hinton)
Strictly speaking it was just 1 and 3 which jumpstarted the revolution in computer vision, but the importance of LSTM for sequence modelling (language and speech) is hard to overestimate.
3. Sec. D and XIV say that the convnet was scaled up already in 2011 through the DanNet from Schmidhuber's lab. DanNet was the first convnet to win a computer vision contest. It also was the first convnet to achieve superhuman performance and had a "monopoly on winning CV competitions." It won 4 CV contests before Hinton's AlexNet won ILSVRC.
It's true. I checked the references.