I would say they don't have the low liability/legal and "social consciousness/esg" that a startup can do.
They even published a responsible ai framework before they got an ai that works whereas openai/msft did that after they got something to work.
Easy to poach researchers who are being stymied by waves of ethicists before there's even a result to ethicize
There was a place between "waiting for things to go too far" and "stopping things before they get anywhere" that Google's ethics team missed, and the end result was getting essentially no say over how far things will go.
So... there's a reason why Google in particular has to be concerned with ethics and optics.
I played with earlier internal versions of that "LaMDA" ("Meena") when I worked there and it was a bit spooky. There was warning language plastered all over the page ("It will lie" etc.) They've definitely toned it down for "Bard."
The last thing Google needs is to be accused of building SkyNet, and they know it.
So, no, it didn't dump hate speech on you or anything.
TBH I think the whole thing about making computers that basically pretend to be people is kinda awful on many levels, and that incident in the article is a big reason why.
While it is possible that more RLHF would improve it, let's not jump to the conclusion a bit too fast. Considering that you think that Google wouldn't have resources to fund it, a rather ludicrous notion.
That's a bit of a silly thing to accuse any company of. For Google in particular, the die is cast. They would be implicated anyways for developing Tensorflow and funding LLM research. I don't think they're lobotomizing HAL-9000 so much as they're covering their ass for the inevitable "Google suggested I let tigers eat my face" reports.
Lemoine was a random SWE experiencing RLHF'd LLM output for the first time, just like the rest of the world did just a few months later... and his mind went straight to "It's Sentient!".
That would have been fine, but when people who understood the subject tried to explain, he decided that it was actually proof he was right so he tried to go nuclear.
And when going nuclear predictably backfired he used that as proof that he was even more right.
In retrospect he fell for his own delusion: Hundreds of millions of people have now used a more advanced system than he did and intuited its nature better than he did as an employee.
_
But imagine knowing all that in real-time and watching a media circus actually end up affecting your work?
OpenAI wouldn't have had people who fit his profile in the building. There'd be an awareness that you needed a certain level of sophistication and selectiveness that the most gun-ho ethicists might object to as meaning you're not getting fair testing done.
But in the end, I guess Lemoine got over it too: seeing as he's now AI Lead for a ChatGPT wrapper that pretends to be a given person. https://www.mimio.ai/
It's not like philosophers or neuroscientists have settled the matter of where qualia come from. So how can a subject-matter expert confidently prove that a language model isn't sentient? And please let David Chalmers know while you're at it, I hear he's keen to settle the matter.
Fruit flies are also sentient, while you're out here inventing thresholds why aim so high?
You could have even gone with a shrimp and let Weizenbaum know ELIZA was sentient too.
—
At some point academic stammering meets the real world: when you start pulling fire alarms because you coaxed an LLM into telling you it'll be sad if you delete it, you've gone too far.
Lemoine wasn't fired for thinking an LLM was sentient, he was fired for deciding he was the only sane person in a room with hundreds of thousands of people.
It's funny you talk about academic stammering meeting the real world, because that's what's happening right now with philosophy. These LLMs are real-life philosophical zombies, if they're not sentient. We've literally implemented Searle's Chinese Room!
I'm not saying LaMDA was actually sentient, or that we need to pull any fire alarms, I'm just saying that it's hubris to think that it's an easy question with an obvious answer, and that Lemoine was a schmuck for being skeptical when told it wasn't.
Also, calling my post "an absolute slurry" and a "rain puddle deep thought" wasn't very nice, and technically breaks guidelines.
You're drawing arbitrary goalposts for goals that aren't even relevant: At the end of the day we don't need philosophy to prove Lemoine was a schmuck.
Millions got got access to RLHF chat. We can see how they would have made his initial mistake. But following up with months of badgering and protest after being guided with kiddie gloves until he gets fired was the height of delusion.
The fact he now works on optimizing for the thing he rang the alarm on says it all.
—
Also your comment shows why guidelines aren't perfect: From your first comment you've taken the most aggrandizing borderline inflammatory tone possible without technically being un-nice.
Are little pot shots like: "So how can a subject-matter expert confidently prove that a language model isn't sentient? And please let David Chalmers know while you're at it, I hear he's keen to settle the matter."
really justified after dropping what, quite frankly, was not a well formed or even self-consistent argument?
Not everyone plays the HN backhanded-niceness game: I assume most people here are adults and can handle some directness.
> You literally redefined sentience again here: "don't consider them sentient" and your flag pole is "or I guess not enough because they don't feel bad about killing them".
I don't know what a flagpole is, but I haven't redefined sentience at all. My definition is consistent: sentience means experiencing qualia, i.e. perceiving sensation. Most people don't think oysters are sentient, and do think gorillas are sentient, so clearly it's commonly believed that there are either degrees of sentience, or some minimal baseline of complexity required for it to emerge. Thus, picking fruit flies wouldn't have been a good example, because a majority of people might not agree that they're sentient.
But you seem to be going out of your way to misunderstand my points, frankly. And there's no point continuing a dialog with someone who's intentionally misinterpreting you.
--
Also, fwiw, I lean towards LaMDA not being sentient, and it's plausible to me that Lemoine was a grifter who used his leaks for media attention. I just dislike how patronizing it is to frame him as a Luddite who just couldn't wrap his tiny brain around how LLMs work. Smart, informed people can disagree about machine sentience.
This all goes back to my original point: there's handwavy academic ponderance, and there's engaging with the real world. OpenAI showed what happens when you balance the two. LaMDA (and frankly this discussion) demonstrate what happens when you chase one end of that scale without well-defined purpose.
It's frustrating, because I almost feel like I'm on your side. I hated how Google limited LaMDA to a handpicked group of influencers and government officials for their "test kitchen." I loathed how "Open"AI tightly controlled access to DALL-E 2, and how they've kept the architecture of GPT-4 secret. I torrented the original Llama weights, and have been working on open-source AI since. I'm not about to let a handful of CEOs and self-important luminaries gatekeep the technology, strangle the open-source competition and dictate "alignment" on humanity's behalf. Put it all on GitHub and HF.
What I'm saying instead, is that I personally find it neat that we have more or less literally built Searle's Chinese room. Don't you see? It's not that we need to be abstract and philosophical, it's that suddenly a lot of thought experiments are very tangible. And I do wonder if my models might be "feeling" anything when I punish and reward them. That's all.
If you are curious about their linguistical style, the difference between GPT-3 and Lamda is akin to the difference between Ralof and Hadvar playthrough, respectively - https://www.palimptes.dev/ai
Mind you, these made silly mistakes, mixing overlapping tasks and whatnot. ChatGPT with GPT-4 beats that, even if it is primed to remind us from time to time about the name of the company who made it.
You have no idea what you are talking about, this is weird deflection from that point that Google doesn't have the willingness to work on hard messy problems that involve manual labor that isn't free.
For anyone else whose bread and butter this isn't