Hacker News Reader

A cluster of 4 M3 Ultra Mac Studios with 512 GB of unified memory each. Don't recommend. EXO labs is dead and trying to shard models is really hard. On their own, each Mac can generate text at usable speeds, but I assume that you trade memory for speed. I have never used an NVIDIA GPU, so I guess that you trade model capacity for speed. I would like to know what y'all Nvidia people think

View on HN

I have "only" one Mac Studio M3 Ultra with 96 GB RAM. May I ask what spurred you into actually getting four of the most expensive and capable model at the time?

And what kind of work are you envisioning doing on them now or later, if you are not going to sell them? (Maybe even with a profit, I think.)

Thank you for this! I have been debating ordering the new M5 Studios, I am running 2 M4 Macbook Pro Max 128GB each with Exa Labs, I havent noticed issues but I also am not hammering a local model (I mostly do code reviews and some QA). I run the frontier labs models but have built my own memory connector that has enhanced those models drastically.

Reply on news.ycombinator.com