Neural Network Design (eBook) [pdf]
hagan.okstate.edu
hagan.okstate.edu
- Convolutional neural networks
- LSTMs
- GRUs
- Autoencoders
- Attentional mechanisms
- Variations on SGD (Adagrad, Adadelta, RMSProp, ADAM)You will be surprised how little knowledge people have about neural nets ( speaking as someone who did Applied Maths in school ).