That is a shift of comparisons though, right? This thread was about running locally, explicitly as an alternative to cloud services. I would guess few people have graphics cards with > 12GB ram.
There is, for sure, a limiting factor in the x86 architecture, but I think the RTX Spark will change that a bit, and maybe AMD's subsequent Ryzen AI/Strix Halo chips.
In any case, 128-256GB unified memory systems running MOE models is the "cheap" option, RTX6000 is the step above it.
I'm not familiar with these. How much does one cost, and from what store / what product name?