Hacker News Reader

But Qwen 3.8 27b is unbearable slow, you get 10minutes of "let me think" over any trivial stuff.

Qwen 3.8 27B defaults to "xhigh" (its maximum level) for thinking, which makes it diabolically slow. Setting it to "medium" or "low" speeds it up a lot.

It does. It's quite good with the low setting. I prefer Muse Glimmer for, I dunno, hard to explain comfort reasons.

I had to hack the template of Qwen 3.8-27B to get it to go into low reasoning mode. Not sure if that is fixed.

Have you tried Nemotron 74B-9B? (Slow on Mac with llama.cpp due to a missing tensor type)

that nemotron model is such a dog, like all the other nemotrons

I have found it to be OK on sort of general purpose overview code stuff. At the moment it's too slow in llama.cpp on Mac for me to bother testing further.

Reply on news.ycombinator.com