I know for Tensorflow, ROCm keeps their own docker image you can pull against.

Though iirc ROCm isn't supported on recent consume level cards which I find incredulous that wasn't a goal to have working from launch.