Hacker News Reader

Comment by Perenti | Hacker News Reader

I'm finding these LLM announcements to be pretty meaningless. They all look the same, with different numbers and graphs, even though the graphs are almost all identical. The offered model is compared with models that it can beat, with a couple of entries that "show" they haven't engineered the whole benchmark presentation to mislead.

I've become incredibly skeptical of new model announcements until I can find evidence of someone else using it for something effective. I'd love to see an announcement that wasn't structured around attracting investors with too much money and too little domain knowledge.

View on HN

To me the most interesting chart on artificial analysis is intelligence index vs cost per task. It's like the third chart down and they graph a pareto line showing where the frontier is and every model on the pareto line has been interesting to me. Luna, Mimo-v2.6-pro, Sol. Hell, Argon.

This MiniMax model is clustered with Haiku 5.5 so (combined with the criticism on here that it was lacklustre while free on opencode go) I don't find it interesting, but every announcement has a chance at pushing that frontier.

I was benchmarking affordable LLMs for japanese->english translation recently and the winner was Kimi K3 - there are a ton of interesting models in the wake of the flagships.

What would be an interesting LLM announcement, then? Even Opus 5.5 wasn't an interesting announcement but the impact is obviously significant in hindsight.

For me? A local LLM as powerful as opus 5.5 would be interesting. Or a good local 3d asset generation model. Or something as powerful as Opus 5.5 that works nearly instantly.

All this incremental progress is just more of the same. I want a real novel capability, not just more, faster, cheaper, “smarter”.

.. HN is actually hilarious

We are barely 4 years in since the release of a historically important tech. Of course the next few years are incremental. thats how it always works.

Even last year, before opus 4.5, long-horizon agents didnt really work. I would not say the last 12 months are only incremental

what's even more funny is most of what they are asking for exist in some form.

As an aside, I remember when sora 2 launched and thinking, "wow I wonder if we'll ever get something close this in open weights?" The prevailing sentiment was "maybe 5 years." Yet, we have Minimax H3 and Flux a year and a half later.

So you mean I can't run multiple frontier-level agents on my 9 year old 1080Ti?! That's ridiculous, seriously the pace of development has completely stagnated.

When Opus 5.5 launched, within a day you could see that it was a signfiicant step function in capabilities by just following regular subreddits like /r/AIGameDev and /r/ClaudeAI (but really anywhere people publish their software, if you can recognize it).

But this only works for frontier models. If MiniMax catches up to Opus 5.5 in 6 months, no one would notice.

It also works for flash models that push what capability is reasonably available locally, eg with Qwen3.8-flash, Qwen3.8 27B and GLM5.3-flash.

But this only works for frontier models. If MiniMax catches up to Opus 5.5 in 6 months, no one would notice.

I'd be happy as hell if I end up being able to run an Opus 5.5-level model at home within a 6-month time horizon. May or may not happen based on China's export policy, of course.

The open weights we have may be as good as they ever get... but then that's been true all along, considering nobody really knows why they are releasing powerful models for free in the first place.

I think we keep getting used to intelligence improvements and the goal posts are always moving forward.

I remember that close to an year ago i felt the same way about opus 4.5. And even if you can easily run ds or qwen locally to get very similar results to that, we moved to 5.5 being the new target.

Deepseek can do 90% of the job but a claude reviwer/spec writer is a brutal improvement.

Announcements are not interesting. Independent reviews are.

Qwen 3.8 flash next was an important announcement because it easily runs on dual RTX 6000 Pro, which made it available to a subset of fairly high-end local inference tinkerers. For those running local models, checking announcements for vram requirements is the first step in knowing if it’s a candidate to push more intelligence into your local rig. At least, that’s what I do when I read announcements.

With Strata and specialized engines, Qwen Flash Next runs even on 16GB cards.

I use it at 60+ tok/second on a single 24GB card.

Skepticism is due! Good! The numbers don't mean much! Yes!

I personally enjoy seeing how different models view problems. Take big plans from big models, then see how other agents reinterpret a stance. See which directions they go. I love the diversity of views they produce.

It's not really relevant what the numbers are. I really really enjoyed talking with MiniMax M3 a lot. And M2.7. it had a good world view, wrote the situation up incredibly fluently. It thought out loud well. These were pleasant uses for me. The realities, the world's they could see felt very grounded. Good stuff, to me.

"I'm finding these LLM announcements to be pretty meaningless. They all look the same, with different numbers and graphs, even though the graphs are almost all identical."

How dare you, sir/ma'am! the LLM spent a whole 0.9 tokens creating the numbers and graphs!!

Reply on news.ycombinator.com