I would love to see a critique of this. I have it in my "todo" to write a program with cuda, and this seems like a way that I would enjoy. The help world program is straight forward enough.
The hardest part of CUDA is getting it installed and recognised by the linker without bricking the machine or throwing strange version conflict errors. Many machine learning engineers can attest to this.
Yes. For some operating systems like NixOS there are not even official packages.
I've been happiest with PopOS! and their preconfigured NVIDIA package. They've done quite well for an out of the box minimal configuration distro that you can jump into ML without all the normal headaches.
This does look good and I like the section at the end listing the tested environments. I have not tried it myself, but Julia has good CUDA support, and that might be a larger community to get involved with.