Warning from OpenAI leaders helped trigger Sam Altman's ouster
washingtonpost.com
washingtonpost.com
1. Pressure to maintain numbers
2. Fear and silence
3. Young ‘uns and a bigger-than-life CEO
4. Weak board of directors
5. Conflicts of interest overlooked or unaddressed
6. Innovation like no other company
7. Goodness in some areas atones for evil in others
from "The Seven Signs of Ethical Collapse: How to Spot Moral Meltdowns in Companies Before It's Too Late", 2005 by Marianne M. Jennings, professor of legal and ethical studies in business in the Department of Management in the W.P. Carey School of Business at Arizona
Quoting of vague "ethics" risks around AI, or neutering LLMs in the vein of making them "safer" seems dubious to me. Obviously, there are a huge number of problems which depend on safe AI - where safe often means something completely different from what is currently being talked about. e.g. does the AI reliably do what I expect it to do in the face of adversarial inputs? does it handle risky settings like deciding to refund customers? How can I ensure that the AI is making legal decisions and not secretly using redlining, or other illegal criteria to make its decision?
Many people think like this is "wokeness" and at best a waste of money, and yet time and time again there are incidents that show in sometimes very horrible ways just how bad biases and a lack of diversity and oversight at all stages - planning, development and post-launch support - can end.
IMHO, ethics oversight and threat modelling based on ethics should be seen, similar to pentesting and QA in AI, software (and, as the example shows, also hardware) development, as an absolute requirement to do - because if you don't do it, 4chan will, and tear your public image apart in the process.
[1] https://www.cnbc.com/2023/05/26/tech-companies-are-laying-of...
[2] https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...
[3] https://fortune.com/well/2023/10/20/chatgpt-google-bard-ai-c...
[4] https://www.standard.co.uk/news/world/automatic-soap-dispens...
The human machine is already tuned to do this navigating of the information landscape. The sense of curiosity itself lures us toward things that are just a little weird -- the goldilocksian zone between familiar and unfamiliar[1]. Our minds are designed to bridge gaps and seek paths into otherness, but only when the individual steps are small. We are built to seek, grow understanding and incorporate diverse thought :)
[1]: https://nautil.us/curiosity-depends-on-what-you-already-know...
> Within hours, messages dismissed the board as illegitimate and decried Altman’s firing as a coup by OpenAI co-founder and chief scientist Ilya Sutskever, according to the people.
>people identified as current OpenAI employees also described facing intense peer pressure to sign the mass-resignation letter.
>“Half the company had signed between the hours of 2 and 3am,”
It's also consistent with OpenAI's board comprehensively botching their response to those concerns, even if had been clear that over the medium term Altman needed to be managed out. That's why there's a term for this ("managed out").
Instead, the OpenAI board created news cycle after news cycle of palace intrigue by seeming obliviousness to how their actions would be read.
"Well, I think I’ve been in the top 5% of my age cohort all my life in understanding the power of incentives, and all my life I’ve underestimated it. And never a year passes but I get some surprise that pushes my limit a little farther." -- Charlie Munger
> Altman’s departure jeopardized an investment deal that would allow them to sell their stock back to OpenAI, cashing out equity without waiting for the company to go public. The deal — led by Joshua Kushner’s Thrive Capital — values the company at almost $90 billion, according to a report in the Wall Street Journal, more than triple its $28 billion valuation in April, and it could have been threatened by tanking value triggered by the CEO’s departure.
Ok so the company was offering a cash out of 3x and the long term employees are most likely to have most power and influence within the company. Yeah, no undue coercion that everyone is so motivated by this they’re signing things at 2am? Or more like they’re reading tea leaves and don’t want to be the odd man out because this is a convenient enemies list if your name isn’t on it, especially since Sam apparently has a history of manipulative and retributive behavior + a huge pay day for either you, your bosses, or people who have significant standing to impact your performance reviews / career trajectory.
To me, the tea leaves at the time said “a once in a lifetime acquihire that will rescue everyone is about to happen OR Sam will come back and the damage will be undone”. There’s life-changing amounts of money on the table and signing a letter with the majority of employees is a no-brainer for the upside scenario.
And to-be-fair, a lot of people were up at 2am waiting for news on this drama. A lot of people with no skin in the game with nothing to lose were watching it intently. Why wouldn’t the employees of the actual company do the same?
Also, this line seems self-contradictory. There was no influence, but people were "begging" others to sign?
A: I tried, but I couldn't edit the Google doc.
B: I could put your name in for you.
. . .
People don't just spontaneously wake up at 2:30 am to sign a letter.
This adds some additional material, like blaming internal chaos on Altman inconsistencies, which seems consistent with what the Atlantic was hinting at: https://www.theatlantic.com/technology/archive/2023/11/sam-a... https://news.ycombinator.com/item?id=38341399
(It also seems consistent with the reporting on Altman's firing from YC, which suggested that it wasn't any single smoking gun or crossed redline, just a pattern of behavior which eventually led to his ouster and some internal YC reforms: https://www.washingtonpost.com/technology/2023/11/22/sam-alt... https://news.ycombinator.com/item?id=38378216 )
That this article is written by Nitasha Tiku, a Gawker alum, casts even further doubt on its claims.
https://www.lesswrong.com/posts/QDczBduZorG4dxZiW/sam-altman...
Why would the employees buy the coup leaders pitch when they barely explained why it happened in the first place?
The story of the next day's morning meeting was everyone was unsasitfied for the reasons they were given, they were as confused as everyone else, and then the next story is the employees all signing a letter and Ilya doing a 180.
Why would the employees immediately trust the new leadership by a board member not involved in day to day operations? I doubt it's all just about making more $$ under Sam. It's about trust and stability.
Everyone was talking about how it was about AI saftey vs reckless capitalism but tangibly we still have little evidence of that. What we do have is Sam critiquing Helen's paper, then suddenly half the board is moving against Sam and an interim CEO whose slow-AI-dev views on AI, which are 100% in line with Helen's paper, is replacing him. While the conviction of the other board members like Ilya seemed pretty thin.
The problem is that stock traders hate uncertainty, and ousting the CEO of any company brings massive uncertainty. So in the short term, an ousting of Elon would probably tank the stock.
And Tesla wouldn't be Tesla without Elon, it wouldn't be nearly as innovative. There definitely wouldn't be a Tesla Semi that is going to change the trucking industry, there wouldn't be a Cybertruck that is going to change the farm truck industry. EVs wouldn't be nearly as far along as they are now.
I suppose ousting Elon would keep Tesla where it is now, but that is like ousting Jobs from Apple. Elon has many great ideas and he delivers.
I don't have to agree with his personal politics to really appreciate what Elon has done for humanity. He is one persistent person, and he gets things done. I mean, how many people have internet access now that didn't before due to Starlink. It wasn't just him obviously, it was a very large team of people. But he somehow got those people to believe in the mission. And THEY delivered. And I don't think we would be where we would be today with renewable energy and electric vehicles if it wasn't for his contributions.
Again, we don't have to like the whole person to appreciate their contributions. None of us are perfect, and some of us say highly offensive things in public hat can feel very threatening and may actually be threatening to some.
I think Elon's public statements sometimes are taken even more seriously because some/many of us idolized Elon (myself included) for a while. And there was this big reveal of like "oh, I don't like that part of you", "what you said was insensitive and mean". And then this tendency to "throw the baby out with the bathwater" and overlook everything great that he has done.
It is a complicated thing for sure.
Pure delusion.
The Tesla semi might be alright for intra-city deliveries, but it's a god-awful idea for long haul trucking. Tractors rarely sit idle long enough to charge. They'll drop off a trailer at one dock, then immediately pick up a trailer from another dock and get back on the road.
Also, talk to any trucker about the semi and it'll be clear they didn't actually talk to any truckers in their design. They've got a whole list of complaints.
> there wouldn't be a Cybertruck that is going to change the farm truck industry.
You're joking, right? Like, this gotta be a troll post.
> Elon has many great ideas and he delivers.
He delivers 3-5 years behind schedule. Roadster was announced in 2017 for 2020. It's 2023 and Elon and Tesla are completely silent about it. They also announced the ATV, and I doubt that'll ever actually happen.
Don't get me started on FSD, which has been 6 months away for nearly 10 years.
"Smooth talking psychopaths" can make you rich if you get in early enough and not left holding the bag.
Better to be a thomas edison than a tesla.
I think mostly because he didn’t seem devious, or self serving, just blunt and his mission was to the company or product more so than to himself.
A great example of why America is in social and political decline. The base nihilism of the con man figure is now the quintessential American aspiration.
https://www.discovermagazine.com/technology/the-cruel-animal...
And also who claimed to have invented a telephone that talked to the dead[0], btw.
[0]https://www.atlasobscura.com/articles/dial-a-ghost-on-thomas...
This is something a sizable portion of populations do. You may not do it yourself, but understand are people are going to behave like this and prepare accordingly.
In contrast, it is equally obvious Elon dragged $44B into the road and set it on fire.
Geez, man. A contortionist would be envious of how you.
https://www.theverge.com/2023/10/30/23938969/x-twitter-valua...
Did the Washington Post really publish this?
Fundamental factual error, about a figure who anybody doing OpenAI kremlinology would be extremely familiar with.
Inspiring reporting by the Washington Post as usual.
There are lots of decisions where consensus has to be forged by getting skeptical people onboard. If I had to guess, it probably went something like:
---
SAM: Hey, I think we should remove Helen Toner.
EMPLOYEE A: Hmmm, I'm not sure I agree.
SAM: Well, [reasons x, y, and z], and I'm talking to [employee b] to see if they agree.
EMPLOYEE A: Well, if [reasons x, y, and z] are true, and [employee b] wants to fire her, then I guess I could be convinced.
[later]
SAM: Hey [employee b], I think we should remove Helen Toner. I talked to [employee a] and they said they would be open to it.
Sam to A: We should get rid of Helen. B, C, and D agree with me.
Rinse and repeat. Typical Mean Girls stuff.