Hacker News Reader

Comment by jstummbillig | Hacker News Reader

Why is that interesting?

Stepfun made a close to SOTA model with 3.5. They got overtaken quickly but have shown enough to be given attention when a new model releases.

It’s also an open model. Even if you only use Opus and Sol, these open models help push them and the frontier.

Seems like it was an under-noticed model back when it came out because there were so many new Qwen models coming out around the same time. I tried it some on my Strix Halo box, but it was right on the edge of fitting.

3.5 Flash was decent, but I was using it on OpenRouter. What model are you running on your Strix Halo nowadays?

Qwen-3.8-flash-next @Q4

Not sure why this is downvoted.

It is fully possible to run the 180B Owen model on strix halo using strata and even get reasonable speed out of it.

https://github.com/Niko1221/Strata

Indeed - Even with llama.cpp you can store n-grams to disk and use it. I m using unsloth's llama fork atm but a new llama release is out that may be better - hadn't had time to test it yet.

Yes, this on Halogen. I can get ~45tok/sec which is quite usable.

Back in their 3.5/3.7 era [1], they had a small+fast model, specifically eschewing knowledge, and instead focused on "general intelligence" like managing tool calls, orchestrating sub-agents, etc. Could be a very good substrate for running a personal assistant (time will tell what's the right approach); so I'm curious to try that out and see how they've come along since then.

[1] https://news.ycombinator.com/item?id=47069179

well, it's free for now , beyond that eh.

Reply on news.ycombinator.com