> I guess the quickest solution is to checksum the pyproject.toml

This is the kind of stuff bazel/ninja do.

https://bazel.build

https://ninja-build.org