I ran a cluster of ~30k blade based computers booting entirely off iPXE. They didn't have any onboard ssd/disk storage or ECC memory. Every day, a few of them would randomly lock up, they'd reboot with a fresh network image and keep on humming.
There same ones, or random new machines every time?
https://blog.codinghorror.com/building-a-computer-the-google...