I suggest you take a look at Micrograd inplementation and watch video tutorial about it from Karpathy. Also „Python Deep Learning” book is quite good.
In short you need to understand: vector, linear combination, cross product, partial derivative, chain rule and finding global minimum. If you have basics of linear algebra it’s easy to grok this video.