Can’t you use s3 + mountpoint for most distributed CI cache needs?
docker/nerdctl only transfers the context, everything else is cached on the builder. it's very useful for monorepos (where you usually want to build and tag images for every tested commit)
and the builder directly pushes the images/tags/layers to the registry. (which can be just a new tag for already existing layer.)
a noop job is about 2 sec on GitLab CI this way.
sure, it should work nicely. (I just prefer the local disk, it's just a cache after all.)