I forget that they do fundamentally host text, and not video etc.
I somehow thought it would be petabytes. The private repos might be more than that but those are historically paid.
Even a naive deduplication might yield some very interesting results
Reminds me of a time I caught someone using someone else’s code in an interview and passing it off as their own. (Using was fine, it was the claim that it was theirs that bugged me)
The size of all file contents (including older versions of files) is a few hundreds TBs, and everything else (directory structures, revision history, etc.) is under 10TB.
So for GitHub alone it would be a little under that
> We’ve archived 6,000 of the world’s most popular repositories as a proof of concept for future archives.
> The snapshot will consist of the HEAD of the default branch of each repository, minus any binaries larger than 100KB in size.