Has this changed, If I want to go hands on with development using pytorch or whatever is used now, would you recommend an AMD card?
Genuine question, I have not followed this topic closely for years :)
Genuine question, I have not followed this topic closely for years :)
There are better learning resources and a better ecosystem available around Nvidia cards & software (cuda).
Long answer, it depends. It will add more challenges and require significantly more effort (even outside the GPU programming itself, debugging toolchain etc. is a somewhat separate skill). The smaller/less mature ecosystem also means you will have less examples to look at for references.
(If you're just looking to learn, use the free Kaggle/Google Cola T4s/TPUs to get started.)
>development using pytorch
Would probably still play it nvidia safe for more adventurous stuff than token generation even if it has improved