I wonder what he means by "H100 equivalents" - are these GPUs built in-house or from competitors like AMD / Intel that give equivalent performance to Nvidia's H100s?
At the end of the day, the bottleneck is TSMC, on which all GPUs are produced right now, even the ones from Intel.