Reading about how Julia does automatic differentiation helped me to understand this a lot:

http://www.juliadiff.org/