Multilayer neural networks weren’t really a viable tool until the backpropagation algorithm for determining internal parameters was developed in 1985 (cf https://apps.dtic.mil/sti/pdfs/ADA164453.pdf )
Ed: To be clear, the idea to use them to adapt the weights of NNs was also from the 70s but only rediscovered and applied to MLPs by at least two independent groups/individuals in the 80s.
Indeed. The book Talking Nets: An Oral History of Neural Networks[1] covers a lot of this ground. Read it and you'll see many people who were involved in the early history NN's mentioning how backprop was discovered and re-discovered over and over again.
[1]: https://www.amazon.com/Talking-Nets-History-Neural-Networks/...
Without a non-linearity depth doesn’t buy you anything.