IBM CEO says open weight models are now irresistibly good and cheap on-prem

theregister.com

16 points·beardyw··7 comments

Not surprising he says that, but it makes sense.

You mean, those Chinese ones? Not sure I’d trust those….

This is the future Anthropic does not want you to see, because that companies believes they are there for your safety, which is complete BS.

Open weight models are the future.

They are the future as long as someone is releasing them. From what I read lately it could be that OpenAI and Anthropic will get the regulation they caved for and unexpectedly China will stop releasing good open models.

Open weight models are the present.

they're presentish, if you prepped pre Fall 2025. The current prices for local model GPUs is insane.

I picked up the AMD Strix Halo with 128GB a year ago, and had my company pick up a framework one prior to that.

Qwen3.8-Flash-Next is the equalizer. I'm building autonmously with it for personal and work. There's a halogen-flash-server that runs rings around llamacpp.

With the right engineering harness, I'm keeping the same agent busy through 6 million tokens by recycling the context with dynamic context pruning and eviction so it's able to just keep chugging with a little direction & decisions.

Yet another warning sign that Anthropic and OpenAI IPOs are doomed.

Reply on news.ycombinator.com