If you haven't seen it Andrej Karpathy's article on neural nets was posted on HN recently: http://karpathy.github.io/2015/05/21/rnn-effectiveness/