p50 decode 45.5 t/s
p50 prefill 1278 t/s
I'm able to get these engineering harnesses running for 1-2 hours at a time with the right specs.
What exactly are you looking at that needs more?
And the Apple Max/Ultra does it better. The Mac Mini/Studio form factor makes way more sense. These laptops look like conspicuous consumption brand marketing devices. CUDA is worthless--AIs can port kernels.
I got it before the memory cartel.
Just curious what youre targeting that BW is limiting you. I churned through models ans harnesses, and settled on this setup. I also have accessto a blackwell running the samw model to 75 tk/s and 1800 prefill.
I dont really see what youre targeting besides paper specs.