Hacker News Reader

Comment by rzk | Hacker News Reader

It seems to be an A/B testing experiment:

https://www.reddit.com/r/ClaudeCode/comments/1xr9x5y/the_ner...

This account claims Sonnet and Opus 5.6 are in A/B testing now. There is nerfing when they release a new version, for reallocating resources.

https://x.com/tokengremlin/status/2119783808773841101

how reliable is this twitter account?

i've seen people on social media claiming all sorts of things about Fable 5.5, Opus 5.6 and Sol 6.2 and what-not for the past few weeks, but it just seems like engagement farming with no proof

https://www.ueddit.com/r/ClaudeCode/comments/1xr9x5y/the_ner...

And here I thought it was them taking away datacenter usage so they could drop a new model soon.

Do they ever test by giving the model more resources to see if they can give users more for the same price ? Just saying

You know what will never ab test your usage? Local ai. Just saying.

Yep, this.

And with Strata running at 50tok/s on my desktop is all I need. Would I like faster? Sure! But it's super useful in all sorts of tasks now.

I tried it. Nothing local or open weights can touch Fable/Opus/Gemini for my use cases.

What it did you try, and what are your use cases? Genuinely curious.

I am also curious what exactly you tried. Depending on your hardware it might also be worthwhile to stay in-tune with Qwen 4 and GLM 5.5/6.0 leaks.

Realistically it can't match Fable, let alone Opus today. It can however beat basically all of the models from 1 year ago. If last years state of the art is "good enough" for you today then local is great.

What open-weight models can match Opus 4.x or GPT 5.4 performance at a reasonable throughput?

Reasonable throughput depends a lot on your hardware. I'm running Qwen3.8-Flash-Next on a 128GB Strix Halo box at 50t/s gen (using the gufo inference engine) and it feels like Opus4.6/4.8 level performance. It's an amazingly good model. I've got it coding a C->microcode compiler in OCaml and it's doing great (there's also verilog code generation involved as well so this is a pretty good stress-test, I think).

I'd argue that Qwen3.8-Flash-Next is basically at Opus 4.6/4.8 level from about 6 months ago.

Last year's state was not good enough for me, but this year's state next year would be great

Interesting, mine freezes the whole laptop:-)

100% agree. A local model might not have the same stretch goal capabilities, but at least I don't have to constantly second guess myself in terms of the inconsistencies I think I'm noticing.

No longer am I constantly made to feel like Ingrid Bergman in that movie with all the lights.

Local AI is the way forward. Using someone else's harness and someone else's model is just borrowing a workflow that's liable and likely to change on a whim.

Reply on news.ycombinator.com