you can mount a specific device to docker. If you read the script, we are mounting GPUs

https://github.com/slashml/amd_inference/blob/main/run-docke...