How else would you learn about neural networks? You have to write code that expresses the network with some kind of executable semantics, e.g. PyTorch, JAX, Keras, &etc.
Like given a network what do you think will happen if we change sigmoid to Relu? And then actually change it and show the result?
Our Physics books in high school had pretty nice and challenging questions. I am not sure the best place to access those for ML/AI.