I will only consider AMD GPUs for LLM when I can easily make my AMD GPU available within WSL and Docker on Windows.
For now, it is as if AMD does not exist in this field for me.
For now, it is as if AMD does not exist in this field for me.
$ rocminfo | grep -E "WSL|XTX"
WSL environment detected.
Marketing Name: AMD Radeon RX 7900 XTX[1] https://rocm.docs.amd.com/projects/radeon/en/latest/docs/ins...