I also think that even in the absence of massive breakthroughs, there's still plenty of work to be done during a "winter" in filling in the gaps of understanding between various SOTA advances. I think it may be the nature of science to advance in a sort of unbalanced tree of breakthroughs, where we drill down on certain popular and lucrative branches for a while before coming back to fill out and balance the width of the tree, if that analogy makes sense.
Just between transformers/autoencoders, GANs, classic classifiers, and combinations thereof I think we are already poised to see neural networks change society in the next ten or so years in a way similar to the influence of the internet. Especially if hardware and cloud computing continues to scale.