What is the solution? Is there a reason why things are not better? Can all of the deps be loaded in a Docker image and be done with it?
It's a shame, I think the field is one where reproduction of results should be really welcome and feasible.
Yeah, a docker image would be nice. Even a Dockerfile, even though that in itself may not guarantee reproducibility if you try to build it later. (And may have issues with gpu drivers etc). But at least it documents all assumptions about the setup.
There are languages ecosystem that solved these issues and never have a problem with it. Look at it, and copy their tooling.
On the other hands, I lost a lot of time with npm, and also a lot with pip.
Someone sets it up, leases out instances etc..
Or someone works to ensure that everything gels together and provides support etc..
Or in other words: 'products'