> They are large enough that you cannot load the entire build graph into memory on a single machine
You mean, multiple gigabytes for build metadata, that just says things like that X depends on Y and to build Y you run command Z?
You mean, multiple gigabytes for build metadata, that just says things like that X depends on Y and to build Y you run command Z?
I highly doubt that, after doing all those tricks, you still end up with 100GB - 1TB of build data.
I guess the downside is that the system would be more complex overall, but you can probably get 80% of the result with not so large changes