Hacker News Reader

Comment by synergy20 | Hacker News Reader

really? epyc used a lot for host cpu to work with nvidia gpus, which is totally cuda, nobody uses rocm for ai.

Check out https://top500.org/lists/top500/2022/11/ - of the top 10 supercomputers, 2 are based on AMD GPUs, 5 on NVIDIA, and 3 are more specialized solutions.

All AMD has to do is offer lots of petaflops on the cheap, and software that technically works. Once the hardware is there, and research groups have won grants to work on it, it's up to grad students (who actually do the research work) to figure out how to get anything done on ROCm.

AFAIK AMD based supercomputers were chosen for their traditional HPC perf (eg. FP64) perf not AI perf (eg. BF16, FP16, FP8, INT8)

That's true, MI300 might be the first real device geared towards AI indeed.

Check out this https://www.anandtech.com/show/18721/ces-2023-amd-instinct-m...

hw cool,it does not mention rocm the software though. I read somewhere that says ROCm is only like 5% of what CUDA stack offers, it's basically just cuDNN in CUDA solutions.

Yes, yes. I've heard all the rants and agree to some extent because they seem to target different markes. I am not even sure is even trying to compete with Nvidia.

MI300 is specifically targeting AI and ML markets, which is in direct competition to Nvidia. They're competitors in the GPU market for a long time, MI300 is the first offer from AMD to get into ML high end market, the point here is that, AMD needs to invest in ROCm 20x more to be serious in the new segment, on the other hand, its EPYC is doing extremely well already used with Nvidia ML chips.

From H100 Nvidia tries to use its own host cpu, of course AMD now wants to have its own accelerator the MI300, soon they will each have their turnkey systems, it's just that AMD's software stack is still way behind.

Again, I mostly agree. I alluded to AMD not really trying to compete with Nvidia. I know these are public companies but they are run uncle and a niece. Sometimes it does feel like AMD is trying really hard not to compete

Indeed the CEO of Nvidia and AMD are both from Taiwan and about the same age, I was told they are actually good friends, so yeah they might not want to fight that hard. I will call them the cousins, maybe they can first crash Intel together.

Reply on news.ycombinator.com