Large, cleaned, tagged datasets (like imagenet) get at least as much credit as raw compute. I think everyone was surprised at how well deep CNN quality scaled when given appropriately large training sets.
The improvements in techniques make new discovery faster and news discovery create better techniques.
Interesting times...