1,554 karma · joined November 27, 2020
Any bad actor worth their salt is already a) going to have the weights downloaded, forever, to various models that are good at hacking and b) is out of reach of the U.S. government anyways. A ban on open weight models, plus paternalistic gatekeepers of cyber models like the big labs, just opens up Americans and American companies and municipalities to hacking from abroad. Or I guess to a really nice racket where only the big labs can offer a “we’ll continuously monitor and improve your cybersecurity for millions of dollars a year”.
“We're taking a deliberate approach to rollout and are actively engaged in the U.S. government’s voluntary process for pre-release model testing. Starting this week, we will make Carbon available to a subset of cyber defenders and will gradually phase access to additional trusted partners through our Fairwind Program. We’re continuing to gather feedback and iterate on guardrails before making Carbon available to developers, businesses, and consumers via our product surfaces as soon as possible.”
China and Russia (and to some extent, the UK now) will absolutely act on the spying they do. Or just act and say they had a good reason. China and Russia are dictatorships. One of them has a very competent and hard-working population which succeeds in spite of the dictator, the other is a gas station with nukes that survives solely because of said nukes.
Spying on American citizens is a bipartisan point of agreement.
Speed looks nice too. I want an open weight model with this performance now.
There are lots of real worries (government use to suppress the people with minimal manpower or popular support, brainrot and fake news, unemployment due to the belief that LLMs can replace people, education collapse, etc.) we should instead be looking at. This whole rogue AI shtick is tiresome.
Edit: Dude, you didn’t even use the thing you’re talking about? It’s on OpenRouter. Do better!
Edit 2: OP is a ~60 day old account, only other (positive) commenter is a ~48 day old account. Sus.
It’s ironic that the LLMs which benefit so much from reading arXiv papers of yore are now being used to pollute it. Personally if I see a single author post 2023, I assume it’s junk, especially if they’re not from an actual research institution. Not all solo independent researchers are phonies but … many phonies are solo independent researchers.
OpenReview is okay but even some of the reviewers are apparently using LLMs or just hardly reading.