Mirrors the geohotz rants about AMD at the time, though as others point out this - 2024 - is ancient news in AI world and not quite sure what value it adds to the current discussions
Genuine question, I have not followed this topic closely for years :)
>development using pytorch
Would probably still play it nvidia safe for more adventurous stuff than token generation even if it has improved
There are better learning resources and a better ecosystem available around Nvidia cards & software (cuda).
Long answer, it depends. It will add more challenges and require significantly more effort (even outside the GPU programming itself, debugging toolchain etc. is a somewhat separate skill). The smaller/less mature ecosystem also means you will have less examples to look at for references.
(If you're just looking to learn, use the free Kaggle/Google Cola T4s/TPUs to get started.)