Yeah, there are a lot of technical limitations that we had to work around. Mainly, everything is paginated with a max per_page of 100. We decided to only analyze the 100 most recent gists and repos to not have to worry about that.

For commits, however, we couldn't not analyze them, so we do a ton of processing. Basically, we loop over every one of your repos and loop over all of the pages of commits for that repo. For big repos (i.e. Facebook), that means we end up doing 100s of async API requests...it gets pretty intense.