Hacker News Reader

I'm calling BS on this. Total lack of any specifics, and I don't need to know what brand of hardware is giving them fits. I've been responsible for tens of millions of dollars in hardware over the years of my career and PCIe has never been the source of my headaches. Disk drives, memory, and firmware bugs are the usual suspects. They can get right out of here with their holier-than-thou attitude on this.

View on HN

I worked at a large cluster computing company and we did occasionally, very occasionally see PCIe problems. Note that a lot of people are now exporting PCIe over a cable, not just plugging into the mainboard, and that can be a source of problems ('oops, the PCIe cable was routed in a location that made it experience more EMF, vibration, and physical damage and then it started to show more errors).

These sorts of problems mainly show up if you're running your own fleet, designing your own servers (poorly/aggressively) and have a budget of $10B.

I don't mean to be rude, but did you ever look? Swapping parts because something is wrong would fix weird PCIe errors as well.

Also, PCIe usage has probably grown exponentially over the past 10 years. Its possible facebook has an order (or two) more of PCIe "links" in their datacenters today compared to 10 years ago.

Reply on news.ycombinator.com