My experience with Common Crawl is that it's targeting researchers, because the publish cycle is so long (in web freshness terms) and there doesn't appear to be any webhook or Atom feed which would allow CC to indicate only the diffs that a potential consumer would need to sync