We document how this on our wiki: https://github.com/NVIDIA/nvidia-docker/wiki/Internals

> The added benefit of this is that you can use different versions of the drivers side-by-side (in my understanding).

No, you can only have one driver version, the one that correspond to the loaded kernel modules. Installing the driver inside a Docker image makes it non-portable.