If you haven't already, I highly suggest going through Andrej Karpathy's Neural Networks course. He covers some of the history and evolution of neural networks.

https://karpathy.ai/zero-to-hero.html