> There are many choices for a loss L (e.g. gradient, Hebbian) and optimizer (e.g. SGD, Momentum, ADAM). The output(), y, is detailed in step 4 below.
I don't get it, don't all of those optimizers work via backprop?
I don't get it, don't all of those optimizers work via backprop?