Yann gave a talk at my university last week. It's really astounding how far deep learning has come from performing classification and regression to now doing things like reasoning and generation. Does anyone else find this wild? These are tasks that historically required a tremendous amount of domain-specific engineering to perform well. And recurrent memory networks just power right on through them.

I understand that learned, dense vector representations are powerful blocks to operate on, but hot damn the trend of general systems that require less domain-specific engineering is an exciting one that blows my mind.