If you want to be unnecessarily dismissive about the problems with containers, sure.
Also the whole point of building the program using compilers/libraries in the container is to use such container to run the aforementioned program in that very environment and not worry about libraryX or utility Y not installed in some box in a galaxy far, far away...
Says who? That's only because that's the only way it works, not because it's desirable to only work like that.
The only way Apptainers work well is if you put everything you need in one Apptainer, which makes them much less useful than you might imagine.