There is very little theory to DL. It's almost completely about empirical results.

You will be very disappointed if you expect that there is some grand theory of Deep Learning.

My suggestion is to follow Arxiv Sanity: http://www.arxiv-sanity.com/top