> China is a safe haven
Heh. It’s a safe haven until your LLM says something the CCP doesn’t like.
Heh. It’s a safe haven until your LLM says something the CCP doesn’t like.
The idea that overly burdensome regulations around open source models in the US shifts the global center of mass of LLMs to China is not implausible.
One reason resonant among government officials against opensource LLMs is to keep them from China and Russia. But among the very best embeddings, ~13Bs and perhaps 34B open-weights models are the Chinese ones. The recent DeepSeekCoder also tops EvalPlus: https://evalplus.github.io/leaderboard.html For those concerned about over-training, ChatGPT and GPT4 are almost certainly also contaminated and there have been independent confirmations of DeepSeekCoder's strength.
Especially due to no freedom of the press in China (you need a permit for each published book) they are all already censored.
I still don't think China could be a safe haven though, they haven't shot down open source models not because they are nice, it's just that they are incompetent.
Even in a fully censored environment, you can still accidentally run afoul of state censors.
https://www.theguardian.com/world/2022/jun/06/chinese-star-t...