I've learned a lot from reading your underscore.js source code.
For me, I started by reading and understanding the raw commented source code from the first release (without the initialization wrapper and initially confusing module setup): http://cdn.rawgit.com/jashkenas/underscore/f4299d7427abc59bc...
Then I had an easier time following the annotated version after understanding how the other functions were built on top of each other in the simpler syntax.