I think the biggest advancement that could come out of the ML space right now is the equivalent of Big O notation for ML. Our current algorithms suck, and the first step to making them suck less is to precisely measure just how much they suck.
There’s so much hype right now that silly money is just being thrown at new tech without fully understanding the value you’re getting.
The problem is just that all this goes out the window for deep learning, because nobody really knows how to prove much of anything about neural networks.
It would be great to have a breakthrough there.