The URL lists were used to distribute archiving of media content. 70TB of text, image, video, and metadata content was downloaded in a few hours with essentially a volunteer botnet.
The team at archive.org is importing the full archive right now.
I don't know about that's Only that the FBI is creating their nofly lists based on it.