Is there a processing-specific user case for this - are we going to see mining containers or game client containers?
There's another unexpected bonus to nvidia-docker; CNTK leaks memory if you abort training prematurely, causing the GPU to go OOM. But since the memory is owned by the nvidia-docker process, killing-and-restarting the container fixes the issue without having to restart the entire system.
They actually created this service using that (a Deep Learning "as a service"): https://www.floydhub.com/
[1]: https://hub.docker.com/r/floydhub/ [2]: https://github.com/floydhub/dockerfiles