I think what differs deep learning from other machine learning techniques is the ability to form a hierarchy of features by itself. I think most of today's successful deep learning systems focus on supervised learning. For me I certainly want to know more about CNN and Caffe, but I also want to learn more about how to apply deep learning to unsupervised learning and reinforcement learning. Any paper/course suggestion?