People used to say that if you aren't paying for the product then you are the product. How do we think open weights will be different?
People used to say that if you aren't paying for the product then you are the product. How do we think open weights will be different?
The position of the Chinese government is that AI should aid humanity and it shouldn't be "owned" by, in particular, a US tech company. That would be a strategic threat to China. So in classic Microsoft style (of commoditizing your complements), China promotes open weight models.
I believe that all these big AI companies are trying to cash out before the inevitable happens, which is their moat dries up. Their moat is the model and the hardware. Frontier models are typically viewed as having less than a year lead on China's best models. The hardware moat is access to NVidia's best chips. That one will last longer but is also at long-term risk.
Open weight models are like how Linux was when commercial *nixes were still common.
The hard part about a wikipedia model, overall: it costs hundreds(?) of millions of dollars in compute to train these things. Will we be able to get enough donations to afford that?
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_...
Annual Budget: $207.5M
https://news.ycombinator.com/item?id=49732270
I have been told pre-training is now much cheaper than post, but let's say $5M in total?
To be clear, I'd love a donation-funded open model that could compete with the big players. But I just don't see it on the horizon.
To me, a company like Nvidia may be the only rational company to make an open model. At least they can sell you compute. And they have. But AFAIK, they haven't come close to the frontier models and I haven't seen much movement from them in a while.
"You're the product" can only apply in cases where the model is being hosted by whoever developed it, so that they can capture the traffic.
Some of these open weight models have revenue sharing agreements between the hosting company (e.g. AWS) and the company that created it.
Apparently Ziphu make money from GLM in China by providing service and support for privately hosted instances, a bit like the RedHat business model.
A look at their accounts show that they're not particularly good at making money.
I like their model, but their financials are a mess.
[0]: https://www1.hkexnews.hk/listedco/listconews/sehk/2026/0831/...
It sure feels like changing that is within the regulatory power of the state. The state can't compete because it isn't trying.