Hacker News Reader

That's so cool. I wonder if the regular M5 can run those models too.

I run qwen 3.8 27b on my m5 mbp, with 48gb of unified ram and I’m getting around 10-15 tok/s.

3.6 35b a3b, I’m getting upwards of 100