It’s making ddr3 relevant again as well. Bought 256GB DDR3 ECC for ~200 usd a couple weeks ago for my ai server (wip).
These old workstation platforms seem to be perfectly fine for hosting GPUs for local llms.
These old workstation platforms seem to be perfectly fine for hosting GPUs for local llms.
My $20 xeons 2696v2 and 2670 are tool old for real offloading, and sata ssd drives are likely a bit slow for ssd streaming :)