There is the rather intriguing prospect of NVM Express over Fabrics (NVMe-oF): https://en.wikipedia.org/wiki/NVM_Express#NVMe-oF
Marvel Octeon 10 DPU (with an integrated 1 Terabit switch): https://www.marvell.com/content/dam/marvell/en/company/media...
Probably pretty soon you'll be able to chuck in a few hot swappable 100 TB Nimbus exadrives (https://nimbusdata.com/products/exadrive/) in there and call it a day. 1T in 1U. :)