Yes, you are right, and I was too optimistic. I'd have to level up.
This is the stuff I've put together and it is clearly too small for this:
https://jacquesmattheij.com/local-inference-with-large-langu...
This is the stuff I've put together and it is clearly too small for this:
https://jacquesmattheij.com/local-inference-with-large-langu...
"PLX88096 PCIe 4.0 Switch GPU Expansionbackplane 4/5 Slot SFF-8654 SlimSAS"
Is the description on the page. That C-Payne switch is a beauty, they make some very nice hardware.
This is also interesting:
The RTX PRO 4000's can still be had at the same price I paid for them, ditto the switch backplane, the enclosure, the PSU and the 2nd hand 3090's as well as the 4090's. What has gone up (considerably) in price is the regular RAM.