Crowdsourced. The crawling and downloading was able to be coordinated and performed by a bunch of people at the same time.