The largest AI models in the world fit on a hard-drive and can be torrented. What makes non-nuclear proliferation realistic is that it's still relatively difficult and expensive to build a nuclear bomb. This model banning thing isn't even worthy of debate given how trivial it is to distribute them.

>Many of them are humbled and worried

Yes, because most of them like to imagine themselves as the next Oppenheimer rather than accepting that they've invented a lossy compressed version of Wikipedia. Chatbots aren't nuclear bombs or "paradigm shifting intelligence infra". I wonder how long it'll take until the hysteria actually dies off.

It reminds me of a conversation with a Palantir guy who at least admitted that he likes it when the press writes a story that makes them look like a Bond villain because every time the stock price goes up. That's why AI luminaries are "worried".