fast.ai also does autograd from scratch - and goes further than Karpathy since it even does matrix multiplication from scratch.
But it doesn’t start there. It uses top-down pedagogy, instead of bottom up.
But it doesn’t start there. It uses top-down pedagogy, instead of bottom up.