> I think Intel / Microsoft have found a way to interconnects scalable and this comes interesting thought on value of have more cores on cpu. Especially if system was designed to be pluggable and if one of cpu's failed than it does not bring entire system down.
I think this is an interesting point. If the QPI links on the Xeon Platinum is restricted to 3, I wonder what the 32 socket mesh looks like and what implications that has on availability of the system as a whole if one CPU was to fail. Also, unless these are fully NUMA aware workloads or each socket was dedicated to a VM, the latency has to be terrible for memory access especially if the interconnect is multiple hops away. Clearly it's not going to be a fully connected mesh?