https://arxiv.org/pdf/2503.11901
This paper puts the failure rate of A100s closer to 0.3%/yr, H100s under 1%.
This paper puts the failure rate of A100s closer to 0.3%/yr, H100s under 1%.
Mind you, most of the H100s that have ever been sold are still in their packaging, I suspect. Or at least not plugged in.
> [...] because quite frankly, the biggest issue we are now having is not a compute glut, but it’s power — it’s sort of the ability to get the builds done fast enough close to power. So, if you can’t do that, you may actually have a bunch of chips sitting in inventory that I can’t plug in. In fact, that is my problem today. It’s not a supply issue of chips; it’s actually the fact that I don’t have warm shells to plug into.
https://www.tomshardware.com/tech-industry/artificial-intell...