Hacker News Reader

I run a cluster of two Dell Pro Max GB10's 128GB unified mem per node 200G NIC ConnectX

what model can you run with those?

same setup -- I run openai/gpt-oss:120b with decent performance for prototyping

For production and an alternate dev environent I've configured and equipped a Dell PowerEdge XE7745 server that holds 8 NVIDIA RTX Pro 6000 GPUs. Again, running openai/gpt-oss:120b (for now)

Reply on news.ycombinator.com