> I have no idea what the concept aims to improve, why it is useful, or how it is an advantage over any other concept.

The sell was "have a box full of compute, and a box full of GPUs, and mix-n-match at provision time." This stuff was directed at cloud providers, so you could let a customer move a slider to pick a core count and a gpu count and spin up a virtual machine without having to rewire any actual PCIe connections (n.b. this was before CXL existed).

Now they're trying to sell it on-prem as a box you throw on your network and provide GPU compute to your machine the way you provide storage with a NAS. Why this instead of just plugging in an eGPU? I dunno... wireless?