I’ve been saying this for the past few months - once the inflection point happens (such as today), it’s only a matter of 2 years when American closed models won’t be able to catch up with Chinese open models
I.e. I would pay 15-20% more for comparable work from an open model I control,rather than use anthro et al.
And it seems we've gotten to the point that frontier models benefits are marginal/nominal. Whereas, not long ago Claude was materially ahead and could do things the other models simply couldn't.
Yes, of course, IF a lot of things. But if we go by what the official positions of the government is, and where the ecosystem is today, then the models stay open, as they are. And today, the US models stay closed, so lets not assume "... IF they stay closed" as nothing is pointing to this changing, just like China seems to point towards staying with open models.
Also leading the frontier is much much harder than catching up to frontier.
I have been wondering if that would be a benefit of using say GLM5.3 on HF if only to get fewer cyber stop flags.
They claim that the default datasets contain so much cyber stuff, so that their models became quite good at it.
They filtered the data before training to not contain this. So it's not that they train the model to not do it. They rather not have it in the Corpus at all. In theory