Running inference on LLMs that can fit in 512GB. For example, you would be able to run either GLM-5.3-Flash or DeepSeek V4.1 Flash 1017 on this, both of which are very respectable models. It's up to you, of course, if ultimate privacy is worth $25k.
No comments yet.