Hacker News Reader

I “upgraded” from an Ubuntu desktop with ryzen 9 and a 3090. I still have the box but it runs like a sauna.

My new set up is a Mac Studio M5 Mac 128gb. Surprisingly it’s still hard to find decent models to fit on 128gb, but Qwen3.8 27b runs FAST so it’s really great as a personal agent that isn’t quantized to heck

View on HN

Try out qwen.8 flash next via omlx/splash.

The Vardsan97 balanced ple8 version is quite good and fast.

I’ll check it out. I tried the unsloth version but it couldn’t handle anything larger than an 8k context window unless I used a 2 or 3 bit quant

holy crap, thank you. Its actually running at 54 tok/s which is incredible for local inference.

Reply on news.ycombinator.com