Anthropic CEO: Open-Source AI is getting dangerous (2023) | Hacker News Reader

Anthropic CEO: Open-Source AI is getting dangerous (2023)

xcancel.com

58 pointstherein25 comments

They just want US authorities to ban big corporations from using models like GLM etc. so that they can keep selling their overpriced tokens. Funnily enough, a ban like this would close to impossible to enforce on individuals, so I guess their lobbying efforts will soon be met by lobbying efforts from big corporations that are losing from this.

Completely stopping people from using open source models is impossible, but if it became a federal law there could be incredible pressure exerted on US companies. For example, OpenRouter might be compelled to not accept open source requests on threat of fines.

I'm just a guy who writes code and geopolitics and big business is usually above my head

That said, I have a suspicion that if the US exerts that kind of pressure on US companies, they will just pivot to using offshore contractors that are doing the things they want

Companies who spend lots of $$$ making a model and then open sourcing it might decide not to if the use of the model were banned in the USA.

I agree with you and just want to add how crazy it is to hear these statements from CEOs as you get older. They literally, literally just say the thing that will maximize profit for their company. Whether it sounds altruistic or not, it's ALWAYS to increase shareholder value (money for the company).

Creating AI monopolies is more dangerous. How much better would it be for environment and privacy if instead of concentrating AI power in few data centers it's distributed across all compute and memory devices? If just few players control the narrative and the infrastructure it's a single point of failure or worse a single point of control. Bad for democracy, society, pushes inequality.

Paraphrasing him, he says that open source software which tool tens or hundreds of millions to build should be classified as a different category. And the implication being they should be banned. Why?

'These tools will become dangerously powerful, which is why nobody should be allowed to have them except through buying them from specifically me' seems a lot like motivated reasoning to me.

Seems like they haven't learned from the last time they played with fire and got their models restricted to only U.S. citizens for "national security reasons".

It’s no different than the “speech is dangerous” safetyism people who push social media moderation, age verification / identity checks, and so on. Ultimately these views that sacrifice rights for safety are from people that don’t really value either.

Dangerous for them. Great for everyone else who want alternatives.

That means open weight models are good enough to threaten Anthropic's bottom line so much that Dario needs to get governments to ban the release of open weight models.

Dangerous for their business model I guess.

We have no moat

https://newsletter.semianalysis.com/p/google-we-have-no-moat...

Actually all the things he lists make it safer for world wide adaption. A closed AI model should be illegal worldwide or at least in no way or form used by the government or public institutions.

Of course, we should only trust Anthropic on this matter.

(2023)

Testimony from July 25, 2023 U.S. Senate hearing "Oversight of A.I.: Principles for Regulation."

https://www.judiciary.senate.gov/committee-activity/hearings...

Do we have recent commentary on open-weight from the Anthropic founding team?

If they are getting regulated to death they may as well bring the rest of the industry down with them, probably

I’d be scared of glm-5.2 as well. It’s amazing and the main model I use now.

The interesting thing here is that Amodei is implicitly admitting he foresees open-weight models (and not "open-source", please...) reaching Mythos-equivalent capability before much longer.

Which, I mean, d'uh; if you've been paying attention it's not a wild forecast.

But it's interesting that he's admitting it.

"Please clap" - Dario Amodei, probably.

Disappointing behaviour from him.

Glad someone was watching and clipped it.

This is from 2023.

oops! Thanks

dario is a faux leader, one of many in the us. western tech is decrepit. best content these days comes from juejin

Reply on news.ycombinator.com