ParentFull threadrwaksmunski·Common Crawl delivers the data as bz2. Indeed I store intermediate data in zstd with ZFS.View on HN