How does differ from the very neat joblib.Memory https://joblib.readthedocs.io/en/latest/generated/joblib.Mem...?
One of the smarted ML researchers I know swears by it.
But for whatever reason, in my workflow of prototyping new ML approaches, optimizing and unoptimizing different preprocessing steps, and sometimes migrating data across the cloud, I always seem to start with joblib and then shed it pretty quickly in favor of large JSONL.gz and sqlite3 etc checkpoints that I create after key steps.