AI researcher Timnit Gebru resigns from Google
platformer.news
platformer.news
1. She and her co-authors submitted a paper for review 1 day before its (external, for publication?) due date. It's supposed to be submitted to Google 2 weeks prior, so they can review.
2. The authors submitted it externally before the review was returned.
3. Google decided that the paper "didn’t meet our bar for publication" and demanded a retraction.
4. Timnit Gebru demanded access to all of the internal feedback, along with the author of the feedback. If Google wouldn't provide this access, she said that she intended to resign and would set a final day.
5. Google declined her demands and took her ultimatum as a resignation. Rather than setting a final date, they made the separation effective immediately.
>Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
Not sure what to make of that - maybe that Gebru submitted the paper and then immediately clicked the "approve" button herself?
The underlying reason for the paper failing internal review looks to be that it basically condemns Google's whole approach to AI (big models) while failing to take into account some relevant research that may favor google's approach. (I have no way of guessing if it would have passed review if it did take into account those, but still condemned the approach).
The massive amount of miscommunication makes her feel like she was being oppressed, due to race and or gender. Hence her aggressive tone in her emails and ultimatum.
Looks like a fairly classic case of a major blowup due to poor communication.
Unless Google deliberately changed the enforcement of the policy just to mess with her, she should have known the policy. It doesn't seem to be a complicated process, and 2 weeks is a reasonably short time to wait.
On the other side, Google has been in this game long enough, that they must know a paper can be updated in this case. So there wouldn't be a misunderstanding there, either.
What exactly happened is unclear so far. But I doubt it will come down to just a series of misunderstanding.
On a side note, I suspect that working research for a company with a conflicting interest in the same area is generally a bad idea. At some point, the dilemma of either leaving or stopping caring about it would present itself.
It's not like there are a bunch of dedicated reviewers, it's always other researchers who review. I don't think some of the most valued papers like MapReduce or BigTable would be reviewed in just a day or two. It's just not a reasonable amount of time in any condition in terms of reviewing research papers.
IRB approval for study designs, yes, admin submission of grants, yes, but never an authorization that the results and manuscript could be submitted to a journal or conference
What you’re describing in this comment sounds like a consortium. These often an embargo on publication of independent manuscripts until the primary paper(s) have been published. However, once the data’s out, each investigator is free to publish whatever secondary analysis they like.
I understood the Google process to be an _administrative_ approval, based on the conclusions of the paper and unrelated to the quality of the science. This I have never heard of at an academic institution. The final call that a manuscript is ready for publication has always been made by the corresponding/senior authors, not admin.
That's a pretty broad statement with no supporting evidence. In fact, I'd argue that most large organizations rely on internal processes to be ignored or bypassed just as often as they rely on other processes to be followed.
I've been on teams that required "every feature" to go through a design review. Guess what? Suddenly a lot of what we were already working on stopped being "features" and started being "small bug fixes". Approvals for launches are often sought from the last few approvers just before launch because the list of required approvers is so long, and the VP of engineering isn't going to approve until everyone else has already approved etc... This kind of shit is par for the course at a large company because the alternative is basically a "work to rule" strike.
Paper writing is painstaking and mentally tiring. It would be much more efficient if they reviewed results and an abstract and then decided based on that "Go ahead and write the paper and publish it" or "Don't waste time writing it up".
Otherwise, everyone and their mother would milk the Google name by submitting papers in every direction.
The second step should be approving the final contents, and that process should not reject a high fraction of submissions and should allow resubmissions with changes.
It would suck to spend 200 hours figuring out how to fight to position figures in LaTeX only to be rejected by some dudes who think the figure is confidential.
This feels like a classic privileged tantrum which has blown up in the face because Google refused to bend this time.
I'm curious, is there anything in the posted information above that points to the fact they were able to go around the 2-week limit in the past? Or is that just a guess?
Jeff's email explicitly says the paper was "approved" then submitted, albeit perhaps in one day. The two-week thing might be a policy but would be immaterial if it ended up approved anyway within whatever timeframe. It sounds like a red-herring to emphasize the time-in-advance; in any case the blame, if any, is to be on whoever flipped the approval bit and did not wait for other reviewers (possibly her manager?)
Look, I am not necessarily picking her side in the more general story, but it is apparent this paper submission story in isolation is super weird. It seems feasible that she was in the queue for getting the axe having engaged in prior fights with the company (some mention of threat of lawsuit, etc). I also acknowledge the account of story from her side was quite cherry-picked and actively strategic, if not deceitful, and it does not even seem that Jeff was a direct player in this saga. Looks the highest level person in the loop was Megan, not Jeff, and Jeff is simply dragged into the mix for the opportunity to throw a punch at his reputation. That, however, does not minimize the weirdness of putting the whole thing on this two-week paper submission policy.
For your last sentence, I think Jeff uses that 2-week policy to state that his position is "technically" right.
> Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
If (to the best of her knowledge) she got approval through the correct process, and then an unidentified party opaquely removed the approval after the fact, I think her questions are justified.
just... wow. Can anyone point to a man ever being labelled in such a way on HN?
Edit: comparing the number of comment hits for " his tantrum" vs " her tantrum" to the relative numbers for " his " and " her " shows that "tantrum" is, indeed, used 2.5 times as often to describe women as it is for men.
To turn it around: an interesting self-experiment is to try flipping the pronouns in the story and seeing if your internal reaction to it changes.
Not understanding Google's policy of retract it now, possibly re-"publish" (resubmit) later after addressing Google's concerns, could very well escalate things, especially since it sounds like this all occurred right as a bunch of people were taking vacation, so ability to get answers to questions/concerns was likely greatly hampered.
If the established practice differs from the nominal process, a no-notice switch to rigorously enforcing the nominal process is for most practical purposes no different than a no-notice change of process. Out of date documentation is at least as common in human processes as software; the real process is what is actually recurrently executed, including how that recurrent practice takes into account position of particular participants.
https://twitter.com/timnitGebru/status/1335017524937756672?s...
In reality, what every company/team/management wants is someone who will give them some constructive criticism on small mistakes here and there that are easy to fix, but ultimately act as a supportive shield for the company against /other/ criticisms. The more credible that someone is, the better, and the more sophisticated that act of supportive shielding is, the better.
In exchange, the company provides support, financial or otherwise, for that someone's personal career ambitions in becoming rich and famous themselves.
Anyone else see it this way? Or am I just too jaded these days?
But reasonable people can disagree about what the status quo is, how good or bad that status quo is, what counts as positive change, what timescale positive change needs to happen at, and what costs/tradeoffs they are willing to accept to accomplish positive change.
Usually is a reason they hire consultants and contractors to do say the unpleasant truths. They can be ignored, reframed, bribed to say whatever, and have the luxury of saying ugly things and then fucking off not long after.
Asking for the review notes is one thing, it seems like the main demand Jeff refused was giving the names of every reviewer. Why would the names of the reviewers be relevant to the academic, unless they specifically wanted to use the reviewers identity in order to undermine the notes?
This is pure speculation, but it looks like there may have been some additional backchannel from the conference reviewers to their buddies at Google that caused a follow-on sensitivity or objection later from other functions at Google, namely PR & Policy (based on her tweets), which may have been why Timnit was super curious about the identity of the feedback authors.
There were clearly conflicts brewing below the lid. This was just taken as the final straw. On both sides, I'd reasonably expect. She was dissatisfied with a bunch of things that she couldn't makr public, so she boiled over on this one. That's why many people are surprised this is such a big deal.
And then she gave a ultimatum, which was great for both sides. For the employer since they could use it to get rid of her right away and make it look it's because of this (and "technically" they are right). And for her because she can use it for maximum outrage. It was a calculated provocation. Come on, if you really want to be part of a process of change, that's not how to achieve that. She is smart enough to understand this.
That seams a big jump. Isn't it more likely that the treatment is due to pushing for ethics in an organization whose business model is antithetical to ethics?
At most CS conferences, there is no second round of reviews (apart from a few PL ones that have been experimenting lately). If you get rejected, it's with the expectation that you make whatever changes you see fit and then submit anew to a different conference. In addition, there is generally no way to update a submitted paper after the submission deadline in such a way that the changes can still be taken into account in the single round of reviews, and making major changes after the accepting venue's review stage is very much frowned upon (as those changes would then not be reviewed). So her options would have been:
1. retract the paper;
2. get the paper rejected from the conference, and resubmit it later;
3. get the paper accepted and have it published without the major changes requested by Google, thus violating Google's policy/interests;
4. get the paper accepted and perform the major changes requested by Google at the camera-ready stage, thus violating academic convention and possibly even specific rules set out by the accepting conference.
2 is mostly 1 with more of everyone's time wasted, and 3 and 4 both violate some obligation or another. From Google's point of view, she might also well have gone for 3 without keeping them in the loop to present them with a fait accompli, and her enormous amount of social capital may have made it easy to get away with. Demanding 1 therefore seems like the most reasonable choice if they want to retain a credible norm of subjecting publications of people who work for them to prior review.
Why would they need those names anyway? I'm also unable to think of any reason they might need the identities of the reviewers.
> Imagine this: You’ve sent a paper for feedback to 30+ researchers, you’re awaiting feedback from PR & Policy who you gave a heads up before you even wrote the work saying “we’re thinking of doing this”, working on a revision plan figuring out how to address different feedback from people, haven’t heard from PR & Policy besides them asking you for updates (in 2 months).
The NY Times reported that four of the researchers working on the paper also worked at Google.[1]
> In an interview with The Times, Dr. Gebru said her exasperation stemmed from the company’s treatment of a research paper she had written with six other researchers, four of them at Google.
It seems to me Google management should have been aware of this paper prior to the day before publication.
----
[0]: https://www.platformer.news/p/the-withering-email-that-got-a...
[1]: https://www.nytimes.com/2020/12/03/technology/google-researc...
Out of curiosity do people think that a company either should or would publish self-funded research that's detrimental to their PR? I'm not sure that this is a realistic expectation with our current methods of company governance (which should probably be changed). I'm assuming the research isn't overly safety oriented and is more like "overuse of google leads to decreased overall well-being" rather that "use of the cigarettes that we sell leads to significantly reduced life expectancy". Of course that statement begs the question of where the line between the two lies.
https://www.reddit.com/r/MachineLearning/comments/k69eq0/n_t...
In my opinion, it seemed pretty low key. But I've only read the abstract.
In terms of Google's expectations and what should we consider reasonable, I'm really not sure... I do think that when they hired this person to be "technical co-lead of the Ethical Artificial Intelligence Team at Google", they probably should've guessed that there could, possibly, be a conflict between "make loads of money" and "ethical".
Is the part that makes me cynical about Google’s motive. What sort of process calls for XFN feedback on your work but withholds that feedback and its sources from you? This is very odd.
https://www.platformer.news/p/the-withering-email-that-got-a...
One can judge the content for themselves, but it was clearly intended to ratchet up pressure on management.
>I’m always amazed at how people can continue to do thing after thing like this and then turn around and ask me for some sort of extra DEI work or input. This happened to me last year. I was in the middle of a potential lawsuit for which Kat Herller and I hired feminist lawyers who threatened to sue Google (which is when they backed off--before that Google lawyers were prepared to throw us under the bus and our leaders were following as instructed) and the next day I get some random “impact award.” Pure gaslighting.
I think if you threaten to sue your employer, the employer isn't too much at fault and just covering their own neck when you later threaten to resign and they take you up on that offer.
“Let’s generate fake data with GANs to prevent our AI from discovering politically uncomfortable regularities!”
It’s ugly work but someone has to do it, right?
Even trivial facts like in English "men chuckle, women giggle" has been used as examples of bias. That's not bias though, that's just how the English language works.
For example:
https://ai.googleblog.com/2020/04/a-scalable-approach-to-red...
I wish this were true.
I'm sure LeCun knows this too. It's a fact that has been known for almost 40 years now, that for a given generalization system multiple bias modes are are possible, and of course the process of optimizing architectures against a biased benchmark will change the learning bias of the model. It's not just datasets that are biased, generalization systems are necessarily biased too.
As for the last line, I don't know that it should be expected for employers to fire employees pursuing recourse against sexual harassment.
I'm sure we can agree that the tone wasn't good, but she does have a point in saying that it's not possible to reduce the bias to datasets used to train the final model.
The paper : http://www.cs.cmu.edu/~tom/pubs/NeedForBias_1980.pdf
The Twitter replies read a lot like her Google message thing. She’s got a lot of good things to say but needs to work on the delivery.
I think she’s playing the victim and race card a lot more than she should. She’s got all the ammo she needs to make her arguments without the angry victim tone.
When she speaks people listen. Nobody listens to wil421.
Based on a long career of watching people trying to convince the others, attacking people is typically a failing strategy. Instead, learn how to message in a way that is non confrontational, and most importantly, make it clear what is your opinion, versus fact.
In any case, Timnit Gebru (this particular AI researcher) has been recognized as having done some pretty important work in AI ethics. Sounds like this whole thing is messy, but thought I'd mention that for more context.
Yann: “ML systems are biased when data is biased"
Timnit: “I’m sick of this framing. Tired of it. Many people have tried to explain, many scholars. Listen to us. You can’t just reduce harms caused by ML to dataset bias. Even amidst of world wide protests people don’t hear our voices and try to learn from us, they assume they’re experts in everything. Let us lead her and you follow. Just listen. And learn from scholars like @ruha9 [Ruha Benjamin, Associate Professor of African American Studies at Princeton University]"
I don't like engaging this kind of discussion but have to call out the "I'm so tired" bit every time I see it.
This is a consequence of the fact that it's not possible to do generalization, and thus learning, without bias to begin with. What an AI researcher does when deciding which architecture is essentially tuning the bias in the generalization system in order to produce better results, which is not in and of itself bad, and is indeed unavoidable.
By bias, I mean really anything that means that the function g() is used over the function h(). In practice this can be anything from the seed for the random values, to the choice of activation function, to the architecture of the network, and so on.
If the architectures are selected for their performance on dataset y, then it is possible that even when trained on dataset x, they retain some of the bias of dataset y, because their generalization bias, which is architectural, was tuned for dataset y. This is, admittedly, a theoretical result, and it's not clear that it applies in every case, but it is a solid point.
For that reason the point that benchmarking against non-biased datasets is important was made, and thus that there is more to bias than the final dataset used for training during deployment. Therefore, it's not only a responsibility of the engineering community, but also of the scientific community.
I've posted it somewhere here already, but here's a nice paper that explains the point that there is more to bias than simply the dataset : http://www.cs.cmu.edu/~tom/pubs/NeedForBias_1980.pdf
Interestingly enough, this is true of all learning systems, including humans, and is a proof of why it's impossible to be completely unbiased in really anything.
In general I take these types of tropes to be cloaked (politically correct) way of saying "fuck x group".
Dataset bias is only one way this occurs, though. Even if you include more colored faces, you still may be taking pictures with a camera that doesn't capture as much contrast. Or even if you retrain, you may have chosen model structure to optimize behavior in a biased dataset. Or... if you're considering the cost of misidentification by a facial recognition system used by, say, police, you need to be sure that you take a perspective that applies to society as a whole and not to your own interactions with police.
It's perfectly reasonable to say "AI is worsening the experience of minorities in various ways" and to differ with responses that assume with slight additional care in curating datasets that the problem will be completely solved.
In France, since you have to be able to explain in plain words the algorithm that was used to help to make an administrative decision, it indirectly makes these black box learning systems illegal.
(And yet they probably already have been used by the police?)
Now, the naive response is that the engineer that implemented a system should take responsibility for any harm done by the system - and I guess that if these engineers could lose their license to use a computer and face jail time, they might also start to put pressure upstream on researchers to provide better systems ?
That statement is contained in a paper I linked that dates from 1980. I'm pretty sure it's factually correct, because I'm trying to make nothing but a demonstration that an idée reçue, that ML systems are only based due to their data, is incorrect.
There's really no cloaked message behind it, and I'm not sure why one would think there is (hence the disclaimer). I think it's a pretty uncharitable interpretation.
That's reasonable. I may have taken the initial text in the wrong context. Thanks for clarifying.
To expand on my prior comment of "Fuck x group", perhaps the tone of prior tweets by Timnit Gebru short-cut me mentally, namely this one: https://twitter.com/timnitGebru/status/1274809418475950080
> Even amidst of world wide protests people don’t hear our voices and try to learn from us, they assume they’re experts in everything. Let us lead her and you follow. Just listen. And learn from scholars like @ruha9 We even brought her to your house, your conference.
It strikes me as very unprofessional, and frankly I believe her anti-white bias shone through in that instance.
Racism is racism, even for "good" purposes.
Personally, I don't think either indicate racism. I see the link you tweeted as an excessively abrasive response at a dismissive and reductive understanding of an issue, bias in learning system, despite research old and new. At the same time, I see LeCun's dismissal as a genuinely held position in error.
To see the first as racist but the second as okay seems to be a case of being much more charitable to one side than the other, though I understand how it may look this way.
It's not "commonly accepted" in the sense of throwing one's hands up, saying "there's just no way we could find enough pictures of black people for our AI to no longer confuse them with Apes" and move on.
“I’m not sad. I’m not sorry. I’m angry. And I’m tired”
In this case, the issue is that "it's the dataset" is attacking a straw man: nobody is accusing ML practitioners to be explicit racists actively conspiring for their models to be racially biased. Everyone understands that it is (often) a result of the underlying dataset.
But, the argument goes, understanding the genesis of such bias isn't enough to excuse it. At least not when those models are put to actual use in, say, law-enforcement contexts. Or credit agencies, or hiring decisions, or really anything.
If your dog happened to bite any red-haired kid it came across, it doesn't matter that you think red-haired kids are just as good as others, or that the dog was once mistreated by a red-haired kid. You're not going to allow the dog to get near any red-haired kids. And if you do, you'll face charges of at least negligence when some red-haired kid gets mauled.
To tie this back to AI, it would mean that as long as your models produce racially biased results, they simply aren't ready for deployment or publication. Go find better data until your work is no longer liable to inflict harm on anybody.
That's the standard for all other industries: if your car is shown to reliably kill pedestrians below a certain height in crash tests, you go back to the drawing board. Adding a sticker "don't operate car in the vicinity of children" isn't enough.
You can disagree with that reasoning (although you'd be wrong). What you can't do, as a leader in AI, is to pretend to have never heard of it, or that it is so obviously wrong that it warrants no reply whatsoever.
> have to call out the "I'm so tired" bit every time I see it.
so... I guess you're tired of it?
Yeah GP is modeling exactly the behavior they're railing against. Claiming that something is wrong without any practical insights for how that thing might be better.
I'm not.
Many other rhetorical moves have a lot of politics to muddle through / implicit assumptions that can be disavowed in bad faith, etc. I don't like to engage in that kind of discussion at all.
But the "I'm so tired" bit is both condescending (and it takes... something... to condescend to Yan LeCunn) and evasive. The end result is authoritarian -- look man, this is decided and settled, you haven't kept up.
Calling this out is interesting because it evidences on the contrary that the discussion isn't settled at all, and that she's unable or unwilling to frame it in a convivial manner that's conducive to progress.
I sit out of conversations I'm tired about.
But isn’t what you described so vague and subjective, that you can apply it to pretty much anything?
IMHO it’s more honest to say “I sit out of conversations I don’t like”, which is an entirely fair and understandable decision to make :).
Well, the disagreement is about publication. Yann LeCun himself said that "The consequences of bias are considerably more dire in a deployed product than in an academic paper."[1]
Why would it be wrong to publish research based on biased data?
I assume she thinks that Yann has enough intellectual capacity to improve situation of biased ML but doesnt execute. Further, my guess is that the reason why he doesnt execute is not transparent to her, hence frustrating.
Isn’t Gebru an “AI researcher”, after all?
Dr. Gebru, among others, expects and insists that they do go beyond that and try to get involved in the social consequences of tech. They refuse, ergo conflict.
Yann has no obligation to do so on Twitter, and shouldn't be called out by coworkers publicly regarding that decision, in my opinion.
Yann was talking about a specific model, she was talking about ML & society on a grand scale. Can't we talk about specific things now? Why did he have to apologize for it?
My feeling is that Timnit is using people, she guilt trips, humiliates them online, makes a big fuss and it's all to whip up support in her crusades. She wants to win the public opinion by any means, so she needs famous opponents to pile on, such as Yann and Dean (who have universal admiration in the field). She's always playing the victim. I find this kind of behavior toxic, it degrades dialogue.
Every practitioner already knows that these models behave according to the data they are trained on. The general public has no use for this explanation because they aren't the one deciding on the training data. So the only practical purpose is to offer some superficial causal mechanism that sounds like an explanation to that public, presented as an unchanging fact of nature, and distract from the equally true fact a biased model is only published or used iff it is trained on biased data and someone decides to go ahead and publish/use it nonetheless.
> You can disagree with that reasoning (although you'd be wrong). What you can't do, as a leader in AI, is to pretend to have never heard of it, or that it is so obviously wrong that it warrants no reply whatsoever.
There's a third option. You can just decide to not engage with the condescending prick at all.
We have one of those at work. His area of responsibility is a very cross functional one, and while it is important, he have a great deal of difficulty getting people to participate. Because participation usually means getting told you're an idiot. Loudly, forcefully, and with more words.
That seems to be the case here, only substituting "idiot" out for "racist".
Am I saying something controversial or micro-aggressive here? So be it.
I have the distinct impression that what they want is for discussions to become personal. Don't let them get to you.
Tiredness is probably coming from trying to educate people on Twitter, you can't do that because tomorrow a fresh batch will come and you have to start over.
Yeah, it sort of implies that, yes, you're angry about something, but actually have no constructive advice or solutions, other than to accuse someone of being a bad person or even a racist.
The "I'm so tired" bit is similar to the "I'm not here to teach you" bit. Maybe someone can't teach you because they actually have nothing to teach.
You of course know about this, or would now about this considering she is called an "AI researcher at Google" in the title of this tread. So the only lazy and un-constructive criticism is to assume she has not made any arguments beyond your one-line caricature of what you believe her to be.
> “I think that now a lot of people have understood that we need to have more diverse datasets, but unfortunately I felt like that’s kind of where the understanding has stopped. It’s like ‘let’s diversify our datasets. And that’s kind of ethics and fairness, right?’ But you can’t ignore social and structural problems.“
This seems to be saying that Yann LeCun should actually be addressing social and structural problems, rather that just applying neural networks to data sets.
https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter...
I don’t know what the right answer is but plenty of institutions come up with ways they attempt to deal with systemic biases. For example, blind auditions for positions in orchestras (you only hear the person auditioning, you can’t see them). Used to not be a thing. Now it is.
Point being that when people are motivated they are able to come up with stuff.
Someone in another thread on this had IMO a great comment[1] summarizing the sentiment:
> If you are going to say "Well, garbage-in, garbage-out!", why do you keep putting the racist garbage in?
It's a collection of images uploaded by random flickr users with permissive licenses.
What if you're a nuclear engineer that just wanna make the hot bit go hotter, and don't want to care about the nasty habit that radiation has of killing people?
If you’re confused as to whom Lecun is, google also “lecun arxiv”.
She says 'let us lead and you follow' -- sure...where? What are we concretely doing about the "in-built bias" problem?
Self entitlement or she forgot she was just an employee, and not some sort of independent tribal leader fighting google from the inside.
It's not clear to me here what you're advocating for -- a lawsuit wouldn't be raised by such an intelligent and virtuous individual unless there was some clear wrongdoing. Are you saying that you think workers shouldn't sue their employers if their employers are breaking the law?
>Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resign from Google.
The most relevant parts (in terms of back story) should be this:
> A week before you go out on vacation, you see a meeting pop up at 4:30pm PST on your calendar (this popped up at around 2pm). No one would tell you what the meeting was about in advance. Then in that meeting your manager’s manager tells you “it has been decided” that you need to retract this paper by next week, Nov. 27, the week when almost everyone would be out (and a date which has nothing to do with the conference process). You are not worth having any conversations about this, since you are not someone whose humanity (let alone expertise recognized by journalists, governments, scientists, civic organizations such as the electronic frontiers foundation etc) is acknowledged or valued in this company.
> Then, you ask for more information. What specific feedback exists? Who is it coming from? Why now? Why not before? Can you go back and forth with anyone? Can you understand what exactly is problematic and what can be changed?
> And you are told after a while, that your manager can read you a privileged and confidential document and you’re not supposed to even know who contributed to this document, who wrote this feedback, what process was followed or anything. You write a detailed document discussing whatever pieces of feedback you can find, asking for questions and clarifications, and it is completely ignored. And you’re met with, once again, an order to retract the paper with no engagement whatsoever.
Gonna have to wait and see I guess.
Maybe someone could post it here when it's published?
We don't know the full list of demands, but Jeff Dean shared one demand that people may find unreasonable. Other demands may have been much more reasonable, but those weren't shared.
Timnit is far from silent. She could share them if she wanted to. She appears to think that that would hurt rather than help her.
The financial implications of her resigning vs her being fired are probably significant.
In Google's place I'd probably negotiate an agreement with a non-disparagement clause. She'd be compensated and everyone would save face.
And we'd never be discussing this. She could take other research roles and advance the state of AI in peace.
As such, I find it really quite baffling that someone would be unwilling to share that scientific feedback with her, or who raised it.
I remembered your comment here, so I came back to post this, for what it's worth.
I'm still not entirely sure what to think.
Maybe my remark is down to earth but, she literally told her group to stop working. I do not know of any company where this is an acceptable behavior for a manager. Besides the disagreements, it sounds to me that was the action that caused Google to pull the trigger.
Also from Dean's email it is pretty clear there are a number of new products down the pipe based on AI. At one point top management decided the company should stop denigrating its own products.
Where did you read that?
in the email shown,she told a listserv called "Women and Allies" to stop writing docs that are an attempt to better the situation in terms of diversity, equity, inclusion as writing those docs are like pissing in the wind in her opinion
Yes she was. Even the letter communicating to her the termination of employment made it fairly explicit that she was being terminated on terms different than what Google interpreted her resignation to be, due to the internal mail.
It's clear that for external PR purposes Google wants to maintain the story that it was merely accepting her resignation, but while clearly worded with the intent that an incomplete reading would support the narrative, the letter to her fairly directly (and unusually for a case where they viewed themselves as accepting a resignation) mad explicit that employment was being terminated, immediately, based on separate grounds from the supposed resignation.
On the other hand, I guess making it explicit that she was being fired for public internal complaints about a culture of discrimination is one way (like, the worst way possible, but one way) of making the case that what happened to Damore wasn't discrimination against white men, but just what they do to any internal criticism of Google culture.
And she was under the impression that her company would value her so much that, not only they wouldn't take the first "clean" opportunity to let her go, but that they'd want her to stay so much that she could leverage it?
That's just you not realizing how your company sees you as a litigious/PR disaster timebomb and are tiptoeing around you. The worst part is that there was a path for you to be professional and achieve your goals, but then I guess you don't get to bask in Twitter's righteous indignation that way.
IMHO we don’t really know if that part (achieving your goals) is true, or not true.
Declining to accept an employee's set of ultimatums, an employee who already engaged in threatening legal action for months and months, is arguably a much clearer framing than "her willingness to assert her rights under the law"
Therefore "recently conspiring a legal battle against Google, while on Google's payroll." is worth sharing, it provides information not present in the limited frame of "her willingness to assert her rights under the law"
This doesn't at all sound like the case. It sounds like the company did something aggressive, she got representation who threatened to sue, and the company backed off, and all of this happened over a year ago and is essentially a closed chapter.
What you called out as "doesn't at all sound like the case": [1: they continued employing her for months and months] [2: while her lawyer was threatening to sue the company]
First paragraph of the email OP posted, which I am defending as worth sharing: "This happened to me last year. [[1]: there has been 11+ months, or months and months, since this occurred and she continued employment] I was in the middle of a potential lawsuit for which Kat Herller and I hired feminist lawyers who threatened to sue Google [[2]: her lawyer was threatening to sure the company]"
My reading is that the situation you're describing is resolved, and has been for quite a while. Thus no lawyer is currently threatening to sue, nor have they for quite a while.
Thus: an employee asserted her rights under the law in the past, and the situation was, apparently, resolved to everyone's pleasure. "recently conspiring a legal battle against Google" is a misrepresentation of that.
Very credibly threatening to sue your employer with a legal firm, regardless of whether you were in the right to do so, is never a closed chapter. Companies are made of people, and those people are not going to forget something like that. They're going to be waiting for their first chance to get rid of you.
Right or wrong, justified or not, if you threaten your employer with a lawsuit, you need to be looking for a new employer that very same day. The employment relationship is now irrevocably a hostile one.
Whether she was overly saber-rattling is, I think, not a meaningful discussion. "How could this ethicist have managed to keep her job" is a straightforward and uninteresting question: don't make any waves, don't challenge anyone too senior, make the company look good in public. "Does Google value talented AI ethicists who are genuinely committed to their work and are willing to sacrifice their career over it" is a much more interesting question.
Google found that there was a credible allegation that Andy Rubin raped another employee, and they figured out how to keep him around for years, until word got out, because he was valuable to the company. (And then they gave him a $90M exit package.) Timnit Gebru got fired while she was on vacation for simply being impolitic. That shows how much Google valued her work.
In a realpolitik sense you are probably right. But right now I'm going through standard onboarding training and they are VERY explicit that it's not supposed to work this way, and that you are not supposed to retaliate or exclude someone because they make complaints or take actions based on the defense of a protected group (including themselves).
It will be difficult for her lawyers to prove that she was let go as a retaliation, which it is not. The only thing which is apparent is that her employer did not value her work as much as she thought, so that her demands and her threat to resign (and the tarnishment of the Google brand because of the Twitter threads which she would write about it) would actually turn into a "clean" opportunity to let her go.
That is what happens when you are supposed to negotiate, and go the confrontational way. You have to estimate your leverage accurately before the full-blown war, otherwise it is a blitzkrieg.
But yeah, another lesson from this: never offer to quit.
> Thanks for making your conditions clear. We cannot agree to #1 and #2 as you are requesting. We respect your decision to leave Google as a result, and we are accepting your resignation.
> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback.
Institutions are being pushed by the Twitter mob, and by the Twitter mob mentality, even when the person is formally within the institution. And I think we're learning, or going to have to re-learn, things like "Why did companies traditionally encourage people to leave politics and religion at the door?" and "What's the acceptable level of discourse within the institution, before you're not a part of it any more?"
Colleges are inculcating an environment and culture that may not be good for working in large groups. One recent example of these challenges: https://quillette.com/2020/12/01/race-and-social-panic-at-ha....
Isn't the word "mutiny"?
No idea if that's happened here, but as a manager I know what I'd do if an employee -- any employee -- told me to to meet their demands or they would quit.
[1] https://www.nbcnews.com/pop-culture/tv/muppets-studio-says-k...
I'm not applying this to Gebru vs Google, as in this specific case, we don't have enough evidence to know what exactly happened.
While I don't like the Twitter mob per se, the idea that a person within an institution cannot publicly criticize the institution is ridiculous. Rank-and-file members should be able to challenge the leaders. The employers can already fire employees for almost any arbitrary reason. Don't like the way a subordinate talks about you? Fire the person.
Colleges promote (or should promote) independent thinking. Independent thinking makes it necessary that employees might disagree with the employer. Is that good for the efficiency of the company? Hard to say. But to say the society must cultivate a culture of obeisance such that people can work for companies better is upside-down. Companies should be built to favor independent thinkers.
It seems like more and more that emboldened employees don't think there is any limit to what they should be able to say/do in a company context, which is a huge problem. If you want individualism to that degree, you need to be in business for yourself. If you take a job at a company, you're implicitly conceding some of that individualism.
And yet, decades ago, when labour had real power and unions were a force in the economy, we had no problems with labour driving change within organizations.
I think what we're seeing now is what happens when individuals are disenfranchised from the political process and labour has no way to organize to drive broader change: individuals, frustrated with their lack of power, speak out and there is retaliation. And where there is a lack of organization, this anger has no focus and what you see is a chaotic lashing out.
I think the same is true of populism in general: when you render individuals powerless you prime them to be welcoming to the populist who promises to fight for them.
Is that an excuse for either Gebru or Google's behaviour, here, specifically? I have no idea. None of us have enough of the details to really understand what happened.
But the idea that labour shouldn't challenge leadership, or that the public in general shouldn't challenge the establishment, is a product of decades of union busting and concentration of power in the political class that we shouldn't accept just because it's become the status quo.
> However, we believe the end of your employment should happen faster than your email reflects because certain aspects of the email you sent last night to non-management employees in the brain group reflect behavior that is inconsistent with the expectations of a Google manager.
> As a result, we are accepting your resignation immediately, effective today. We will send your final paycheck to your address in Workday. When you return from your vacation, PeopleOps will reach out to you to coordinate the return of Google devices and assets.
This third part they make "the resignation" the same as firing the person in practice. No way to plan a coordinated rampdown, transition and handover of projects and responsibilities. Just an unconditional goodbye, don't come to work again.
I'll note also that this is rather unusual practice for Google. There are a number of people, far more critical of Google, who have resigned, and who have been able to rampdown for 2+ weeks.
Is there an example you have, even self-reported, of a person who was merely critical of Google and was not given a rampdown? Or someone who was critical and did not fulfill their job obligations, and was given a rampdown?
Yes, and its unclear what this behavior was.
> Is there an example you have, even self-reported, of a person who was merely critical of Google and was not given a rampdown?
No, which is my point. This is unusual behavior on the part of Google, because it's not explained (and certainly not obvious) what the failure was.
The email clearly states: "certain aspects of the email you sent last night to non-management employees in the brain group reflect behavior that is inconsistent with the expectations of a Google manager"
> No, which is my point.
No, that is the opposite of your point. You said that people critical of Google have been given a rampdown, so it is unusual for her to not be given a rampdown. My point was that there may be other reasons for her not being given a rampdown - that being exactly what was in the email shared about her not behaving as a manager. If you think that she was fired solely for being critical and not given a rampdown, then there should be other examples of people being fired without a rampdown for merely being critical.
> No, that is the opposite of your point.
No, it's exactly my point. The vague justification is not borne out by any evidence.
> The vague justification is not borne out by any evidence.
...that's been leaked onto twitter.
She said she may set a date in the future for her resignation.
That is non-committal and non-specific. Your characterization is inaccurate.
I stand by my characterization. She characterizes it herself thusly:
"I said here are the conditions. If you can meet them great I’ll take my name off this paper, if not then I can work on a last date."
...is both non-committal and non-specific. What are you seeing that everyone else is not?
Citation needed. Gebru could publish it — she's not exactly silent — but chooses not to.
It's perfectly reasonable to think that someone hiding something has something to hide.
I had a job pretty recently, was senior tech and was eager to please, which ended up meaning having to take the hard/after hours calls no one else wanted to handle. It also meant I eventually became the only on-call tech for over 4 months straight. This in turn meant I knew the most about all of our accounts, knew the most about their systems, scheduling for jobs as well as subcontractors, I handled it all, right down to installing the CCTV systems at our new location, single handedly.
When I decided I'd had enough of being taken advantage of and being lied to, I gave my two weeks notice.
They assumed I was going to work for a competitor (I wasn't I was taking some much needed personal time), and they fired me on the spot. While walking me out they also informed me that since they had my resignation letter if I tried to claim unemployment they would use it to claim I had resigned. I didn't care as I wasn't in need of unemployment I was just even happier now about leaving. They were rude, talked down to me and belittled me all the way out.
2 hours after I left the calls began 'how do we' 'how does this' 'this job's permits' 'how do we log into'. I politely told them to fuck off. They even went so far as to have other workers call/text me asking the same questions ver batim.
I will never again give 2 weeks notice unless I have in writing they must give me 2 weeks notice upon release for any reason other than something illegal.
This person offered an ultimatum and their employer made a choice. I just don't think its as bad as early termination of 2 weeks notice.
After those 2 weeks, if the employer still wants help/answers then they should expect to pay a very very expensive hourly rate. :D
As an employer, it makes a lot of sense to accelerate someone out the door that has given notice. That said, you still want them on the hook to answer questions so you should send them home but pay them for those 2 weeks (or however long).
There's no reason to be rude, talk down, belittle, however.
Unless she formally offer to resign it seems like her management jumped the gun.
> I said here are the conditions. If you can meet them great I’ll take my name off this paper, if not then I can work on a last date.
To employers, that qualifies as a conditional resignation.
If an employee tells their boss they have a plan to offer a resignation on x day or do not get y or are considering it they can fire the employee before then, but I assume they can not push around the day they offer a resignation.
An employer not wanting to keep an employee who might soon resign is understandable of course.
I am sure it can get fiddly on what counts as a formal offer to resign and that courts make calls one way or another based on ambiguous language.
Without the email though it's not clear to me. For better or worse it comes across as Timnit Gebru bosses were eager to shoo her out the door though.
If it's that clear cut it's that clear cut. Without the email I can not tell.
Timnit Gebru said she "hadn't resigned" and "had asked for simple conditions". So according to her the intent to resign was not in her email.
https://twitter.com/timnitGebru/status/1334341991795142667
It's possible to not have the intent and still word something as a clear cut formal offer to resign however. With out the email it is not possible to tell where this falls.
"Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resign from Google."
[0] https://twitter.com/timnitGebru/status/1334364732480958467?s... [1] https://www.platformer.news/p/the-withering-email-that-got-a...
Then the language used by Timnit could analyzed and reasoned through to determine if it counts as a formal offer to resign or not.
I not jumping on any bandwagons without at least that or equivalent.
Which is exactly why she has refrained from releasing it throughout this whole drama: plausible deniability.
I do not think there is evidence for that. It is normal to remove employee access to email if they are leaving so it is unlikely Timnit would have access to the email to share.
Timnit says says she has been cut off from her corp account as well: https://twitter.com/timnitGebru/status/1334364734418726912
You say this, yet I have seen it done many times.
Of course not being a lawyer of any sort, I don't know. Is there a reference for your claim?
Jeff's email is in line with what I have seen done elsewhere, and given the high profile of the incident, I'd be shocked if legal hadn't been consulted on the wording.
Husband returns with 12 loaves of bread.
Most software engineers can read the above joke, and laugh at themselves, then go ahead and upvote your comment not realizing that it is EXACTLY THE SAME THING.
Employee: "This is extremely important to me. If you can't address what is important to me, then I can't work here anymore"
Google: "OK, thanks for your resignation".
This is not okay. Google is "technically correct" - but it is appalling behavior that should make every Googler shake with discomfort.
Employees are people. People can get dissatisfied. Frustrated. Angry. Sure, you can say companies don't owe anything to anyone because there is at-will employment.
But the reality is unless we want to live in a dystopia, people should be allowed to voice concerns and anger and frustrations, and not be fired for making things uncomfortable or inconvenient.
If you are instead just saying that Google should have let it slide because it was just an emotional outburst ("anger and frustrations") and not meant to be taken seriously, well, in what context can we hold adults to their word at all? Email is written communication, not an offhand verbal remark uttered in a tense meeting in anger. You should be able to see what you are about to send while typing it, and have ample opportunity to look over it again before you press that "Send" button. If your ability to review your words has atrophied, perhaps under the influence of social media which encourages "unfiltered" stream-of-consciousness venting, then this ought to be on you, simply because it is doubtful that society can function without some possibility of making binding statements and we do not have anything more commitmental than email widely deployed (and operable at the pace of the modern workplace) in work-from-home times.
That something completely UNACCEPTABLE is happening, and needs to be addressed.
If she really wanted to achieve change within the system she'd have needed to not express it this way. There are people on both sides of the table. One can talk to people and find common ground. But that is rare to work if you start with a threat.
Even pull the victim card, blast it all over social media. Sorry, that's a major disservice to everybody _actually_ being dehumanized. She's just dissatisfied with her employer and wants to make the biggest possible splash now.
No. No COBRA benefits and usually no severance. Also the employee is not eligible for unemployment benefits.
> However, we believe the end of your employment should happen faster than your email reflects because certain aspects of the email you sent last night to non-management employees in the brain group reflect behavior that is inconsistent with the expectations of a Google manager.
> As a result, we are accepting your resignation immediately, effective today. We will send your final paycheck to your address in Workday. When you return from your vacation, PeopleOps will reach out to you to coordinate the return of Google devices and assets.
Her resignation certainly gave Google an easy out of all that hassle, but would I call this a firing? Perhaps not.
If you're the employer you have to figure that if somebody's pissed off enough to (i) sue you whilst employed by you, (ii) write that kind of message to others working in their function or group, and (iii) now they've delivered an ultimatum you're unable or unwilling to meet, they're only going to cause more trouble if you make them work their notice period.
If it were me in her boss's position I'd have got her out the door as fast as possible.
The original article has been updated with Jeff Dean's response, while a member of Gebru's team (who still works at Google Brain) states that Dean's email is misleading and inaccurate: https://twitter.com/alexhanna/status/1334579764573691904
As I understand it: The paper had already been submitted to a conference, and the "cross functional team" Dean speaks of basically reviewed it like peer reviewers and said you have to retract it. It sounds like Gebru and her co-authors were not given an opportunity to respond to the criticisms to stave off retraction. If you've experienced peer review, you know that such reviews are by no means a definitive analysis of a paper, and one usually gets the opportunity to respond. Here, it sounds like anonymous internal peer review was used as a hammer to retract it. Dean's descriptions of the criticisms sounds rather pedestrian to me, as a researcher, and I'm sure Gebru and her co-authors would push back on these characterizations.
Honestly, it sounds like the paper was attacking some sacred cows internally. And Gebru's work probably threatened other researchers on other teams. Not unlike traditional peer review mind you, but at least one can usually post in on arXiv without worrying about this.
If the paper was bad it should have been rejected by the conference to which it was submitted. If the paper was critical of things Google does and it didn't like that, that's pure suppression. And, as you say, academic norms provide a period of rebuttal, it's unclear how much was allowed here.
Secondly there is value of having anonymous review in an academic setting, however it sounds like they tried to enforce that anonymous review for the company, which again doesn't serve the same purpose. People should be told exactly why decisions are being made so they can correct their mistakes in the future. If you aren't willing to invite someone into a decision making process, when a large portion of their research is in biases in institutional decision making, then you have got to know you're in for a bad time.
If a company publishes only papers that clearly advance its interests, but the research is sound and independently reproducible, does that bias really lessen the perceived value and quality of the research?
Fair academic criticism: We shouldn't publish this paper because it has flaws X,Y,Z. (usually followed by an opportunity for the researchers to address X,Y,Z).
Unfair and/or non-academic criticisms: We shouldn't publish this paper because: I don't like the author/authors institution. I don't like this approach, approach X is better. I don't like the conclusions.
The last is potentially relevant here. And yes, clearly the quality and value of research is reduced by filtering based on results you want to promote. Which well may be in a companies best interest, but there are sometimes difficult lines to draw - when exactly do you move from "promoting the companies interests" to "propaganda intended to mislead the public"?
The done thing is generally for the reviewers to suggest additional references to improve the paper. If any mention of related work is entirely missing, then that's another matter, but a reviewer thinking that the authors should cite a particular piece of work (e.g. the reviewer's own paper) is not normally something that could lead to outright rejection.
There is not a single software team on planet earth that would not want Jeff as their technical leader.
It is like comparing a high school athlete to Usain Bolt.
Industrial researchers and non-PIs (IE, research analyst working in a PI's lab) don't have the same freedom and integrity rights as a PI. To me this seems like a reasonable (and probably the only reasonable) policy for industry.
I don't really think it's dystopian- if a paper I wrote reached the point of needing a retraction it means some serious messup occurred or there's a major PR fiasco.
Note that in this case I am not sure if there was a retraction, or an desubmission- the paper hadn't been published yet so it's not really a candidate for retraction. The term for this is 'withdraw submission'
It's just as if you'd want to open source some code that you wrote for your job, and suddenly the boss says "hey, don't do that" - there are many reasons why they might want to not publish it, and it's not your code to publish as you want.
To some extent, you have to realize that one day you will fall on the wrong side on the fence and you'll be the victim of your own creation.
In this world, where there are bills to pay and you can't disadvantage yourself if you want to be ok. Having bills to pay is, I agree, just mad.
> Timnit co-authored a paper with four fellow Googlers as well as some external collaborators that needed to go through our review process (as is the case with all externally submitted papers). We’ve approved dozens of papers that Timnit and/or the other Googlers have authored and then published, but as you know, papers often require changes during the internal review process (or are even deemed unsuitable for submission). Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
> A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies. Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues. We acknowledge that the authors were extremely disappointed with the decision that Megan and I ultimately made, especially as they’d already submitted the paper.
> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resign from Google.
Google went through their standard process, and the paper was rejected.
If they have actually approved dozens of Timnit's papers before, then the likelihood that this rejection is due to discrimination seems low.
Big red flag. Why are the identities of reviewers important here? Did she plan to take those reviewers to the court of public opinions for a trial/exposure?
A lesson is delivered in time IMO. Those entitled people need to be called out.
I have a hard time taking someone who looks like that seriously. Says a lot about her and her team.
Why did they not fight to keep her, if she was so singularly brilliant? IMO, it's because she wasn't an employee they wanted to keep around.
People don't get fired for asking for opportunities to respond to criticisms. My guess is there were previous incidences regarding her behavior and, in this situation, she threatened to quit and they accepted.
> So if you would like to change things, I suggest focusing on leadership accountability and thinking through what types of pressures can also be applied from the outside. For instance, I believe that the Congressional Black Caucus is the entity that started forcing tech companies to report their diversity numbers.
This probably shouldn't need pointing out, but appealing to your colleagues to put pressure on your own management via the U.S. Congress seems pretty obviously like a good way to get yourself fired.
If you're going to try to exert political pressure from the outside, you're going to wind up on the outside. I'm no big fan of Google's management, but I find it hard to fault them for this one.
They set themselves up for failure regardless of the paper's content.
Source? The linked article says it was submitted but nothing about whether it was accepted. If it was accepted, is it available for public viewing?
[1] https://www.bloomberg.com/news/articles/2020-12-03/google-s-...
Generally "It worked out, everything's fine" is not a line that flies.
Her email, sent before that claim was made, suggests that wasn't even remotely the case - and it's entirely possible to think "she seems like an ass" and "this smells like bullshit" are both true.
A threat to resign isn't the same thing as resigning. And it seems you don't think so, either, since you characterize her threat as a bluff. It can't be both a bluff and a resignation.
Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date. We accept and respect her decision to resign from Google.
I would say that describes a conditional resignation, and the fact that she called this “being fired” indicates she didn’t really plan to resign (ie. she was bluffing).
The person who benefits from your doubt, _and_ could resolve your doubt, chooses not to.
She cannot and will not expose that information without inviting all sorts of litigation. This is not a case where she can just "choose" to release that information.
So, she might be choosing not to for this reason.
If I say "I demand X or else I resign", (I don't know if that was actually said) I think it's fair to consider that a conditional resignation.
She lives her life attacking people who she disagrees with, and brings in race/gender into any conflict where she's involved.
I am surprised Google had hired her, because it was only a matter of time they'd become collateral damage in this roving tornado of hate and aggression.
From what I have seen today, she gave them an ultimatum: do this, this and that or else I will leave. They decided to not do those things she demanded, and then proceeded to fire her before she could do any more internal damage.
Curious: How did she 'force him to give up on twitter'?
There's a lotta companies who've hired ticking time bombs like this. They don't get why they were truly hired.
> A person: I think bias in machine learning is caused by bias in training data. > Me: Why are you ignoring all I've been saying? You're a racist. You're a white man who oppresses. I'm not going to talk to a bigot like you.
Repeat this a few times, the attacked will be punished both online and offline. Justice served.
More importantly, how should that make us feel about the very real possibility of LeCun serving as an expert advisor on, say, police or other military applications of AI? Would he again just throw up his hands and say, "Well the training data consists disproportionately of black faces, so the model disproportionately implicates black people, nothing we can do about it"?
[0] https://twitter.com/Chicken3gg/status/1274314622447820801
Can you provide a source for this. What did she say?
There are legitimate criticisms of Yann's tweet. Just because he is technically correct about how ML works doesn't mean that what he is saying isn't ALSO a classical dismissal of the concerns people have with AI.
The issue isn't that ML is evil or racist. The issue is that if it is used too objectively detached from the reality of the world it operates in, the outcomes could be used for evil or with racist intents.
AI scientists like LeCun handwaves away concerns about diversity in data sources, just as his employer handwaves away concerns about engagement algorithms surfacing misinformation on the platform.
But the societal consequences remain for others to deal with.
Basically (to summarize a lot), his point was: an ML model is only as good as the data you feed it. If, say, the photos for your face recognition model are only of white men, then obviously the model will do well on white men, while (possibly) not doing as well on other races or genders. This is a statement of fact, and nothing controversial about it.
But she took offense to it, and started insulting him on Twitter. He got tired of defending himself, and just quit twitter.
Other people questioned whether data only can be accountable for the biases and were not subjected to the kind of vitriol she was. The fact I am a white cishet male shields me from a lot of misdirected anger.
That episode gave me the impression she was more interested in drum-beating and axe-grinding than engaging constructively. I'm not surprised she seemed to be doing the same inside Google.
His tweet doesn't rule out the possibility that he secretly has a malicious set of incentives, just like your handle doesn't rule out that you're a Communist spy sent to fracture the American psyche. Yet, its ridiculous. I feel like a lot of the world in 2020 is for some reason a hostile filter is applied ~99% of the time on the internet, and you _rarely_ see that in personal interactions in real life.
Coming back to the original tweet: if you changed the training data have more black people instead of white, would it perform the same but with inverted racial biases? Maybe? You really can't know without doing it. It might generate faces with a dark complexion but also big distortions or unrealistic colors. The original model doesn't just produce white people because of the training data, the hyperparameter tuning, perhaps the entire architecture, would have been modified until it produced acceptable outputs... using white training data. Ultimately the engineers and other humans behind the scenes are the arbiters of success, loss functions are chosen by humans, and swapping training data on the same model won't change those early decisions.
In another context I'm sure LeCun could have offered his somewhat reductionist take on this example of bias (something I might have done myself – reductionism flows in technologists' veins!) A discussion could have ensued, and everyone could have come out with a better understanding. A hot Twitter thread isn't where that will happen. Neither LeCun nor Timnit have the power to change what Twitter is. LeCun (reasonably!) doesn't like the nature of the discussion, and he leaves, and I think that's OK.
How would changing loss functions alter this? This makes no sense.
Hyperparameter tuning is done iteratively, and used get the best score on the test dataset. Do you really believe the engineers hand picked examples and purposefully trained it so that looked more "white" and disregarded the test scores?
Training/test data is 100% the cause for this bias.
A simple example could be sensitivity to color differences: with lighter skin tones there is a fairly large difference between eyebrows and eye features and the person's forehead or cheek. Someone with a pretty dark complexion might have features that are distinguished in a very compressed set of colors. Depending on the loss function a dark complexion face could be essentially flat and featureless.
This could be fixed of course... but it requires changing the loss function.
If internally she has a history of bringing race or sex into every discussion I could see why they'd rather be anonymous. Even being accused of being racist can ruin someone's career in this current climate.
"Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback."
I can imagine wanting to know the feedback, but she didn't ask for that she asked for the identity of everyone person who they consulted.
It could also be that disclosing the feedback would've identified the individual.
Timnit claims that she was told at a meeting called on short notice that her paper was being retracted because of anonymous feedback. She said she asked about the substance of the feedback and they refused to tell her.
After that meeting, she is told she can be read a private document with some, but not all of the anonymous feedback.
That led to Gebru sending a frustrated email to her colleagues and a separate email with conditions that she was willing to resign over. In that email it seems like she asked to knows the identities of the people who gave the feedback that let to the demand for retraction.
Jeff Dean says that Timnit wanted the identity of the people who gave the feedback as a condition for staying. Then he describes what that feedback was. He doesn't acknowledge that Timnit was not given the substance of the feedback in the first meeting when she asked for it. And it sounds like the full feedback wasn't given later during that private reading.
The feedback Dean cites that led to the retraction doesn't at all sound like something that required the protection of identities, and certainly nothing that required keeping that feedback secret. If the reviewers felt like the paper left out some relevant research, why wasn't that communicated fully and clearly in the first meeting?
Jeff Dean's email seems to leave out a lot of context about everything leading up to Timnit threatening to resign. At the very least it doesn't seem like the reasons the surprise retraction order came down weren't revealed at all until some time after that first meeting.
Per Dean, Timnit appears to have precipitated this by violating internal process for a 2 week internal review period and approval before external submission of a paper. (I have no idea how regularly this process is enforced, but I think it's standard in the industry). And then -- reading between the lines -- reacted poorly to the lack of approval. Whence Dean and Megan made the decision to force a retraction.
Then Timnit demanded the names and feedback of the reviewers. Again, as an outsider, I have no idea if the provision of this is customary. But not just the reviewers; also everyone that Dean and Megan had spoken with.
I do wonder how much of this was the irregular process around the paper, her reaction to criticism of the paper, or her public criticism of DEI efforts, particularly as a manager. Or all of the above.
Calling out your leadership chain, both for DEI metrics and for behavior about the paper -- while also disclosing that you seriously considering suing Google -- seems unwise if you don't wish to be terminated.
Perhaps the reviewers were afraid of being dragged on Twitter and possibly having their careers destroyed as a result.
"A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies. Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues."
Is it true that this information was not shared with her?
Nope, they were fired for being a douche.
Ex-ethical AI researcher, we don't know what her next job will be, and she certainly lost an opportunity to lead by losing her place at Google. We are yet to see if this maneuver will cost her social capital or add to her reputation. Also, do you seriously believe being an ethics researcher automatically excludes one from misconduct?
From what we know so far, she seems to have overplayed her hand, assumed she should be treated above rules and when failed at it wanted to take names and encouraged mutiny, in a company where she is a junior manager. Not only there are actual legal complications for a manager to do that, it also sounds like narcissistic and toxic.
Her goals might be laudable, but she have executed poorly and emotionally, and lost an immediate chance to deliver ongoing impact for the ethics causes she cared about. I hope aspiring activist-ethicist-researcher-techies take note of this. Tantrums don't deliver long term impact. Narcissism clouds your judgement. Impassioned supporters mislead you. You have great power, if you wield it responsibly and pay attention not to overestimate it.
> Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
Then, when called out on it, they made "an ultimatum" and said they would leave if certain demands weren't met. I'm not sure what every demand was, but one of them was indeed disclosing the name of the reviewers.
> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback. Timnit wrote that if we didn’t meet these demands, she would leave Google and work on an end date.
Jeff declined to meet the conditions, and let them go. Seems pretty straight forward to me.
I know I flip out at people on the internet sometimes but I hope I never become someone like that.
Her response to that tweet is a bit harsh, but not completely unreasonable. I'm not a Twitter expert, so I can't really stitch together their conversation on Twitter to see where/when it goes off the rails.
A good number of social activists are rude and abrasive and then blame how people react as racism/sexism. No one wants to be around or work with anyone who is a jerk. The quote above sorta reminds me of how this person is going about their life.
I don't think we can infer much from a few highly publicised events.
Of course social activists may at times cross the line and be unnecessarily rude or abrasive. But I'd have more sympathy because their fundamental job is to be subversive and critical of people.
The fact is that Obama has got way more done for America than Omar, so I'm inclined to think he's right.
Many social activists were famously unpopular. Martin Luther King died with a 66% disapproval rating^[1]. Susan B. Anthony was ridiculed and accused of trying to destroy the institution of marriage (sound familiar?).
Of course some activists veer too far. Jane Fonda is an example. I don't fault her opposition to the Vietnam War, but her infamous photo practically advocated for violence against American troops.
In a sense the aim of social activists is to be ahead of their time. MLK was reviled in his time and practically infallible today. We need both politicians and activists for progress. Politicians push forward the policy, but the activists push forward the politicians. Without activists, politicians can end up in holding patterns, afraid to lose popularity. Without politicians, activists are just screaming into a void.
[1]: https://www.newsweek.com/martin-luther-king-jr-was-not-alway...
Being unpopular is hardly the same as being abrasive and rude.
Its funny how the people endorsing Obama's experience on the "defund the police" slogan losing people seem to ignore the other "error" he mentioned as losing people in the same interview: giving too small of a platform within the Democratic Party to voices like AOC's (who, obviously, has the opposite view as Obama on "defund the police") who have proven quite effective with connecting with large constituencies with which the party establishment (implicitly, including Obama himself) has been ineffective.
I would be cautious in selectively referencing that Obama interview to suggest he knows better than "The Squad".
For context he is a black man that has gotten over a hundred leaders of the KKK, including former convicts to leave the Klan. Not by arguing with them, not be reasoning, not by showing them the effects of their behaviour, but instead by sitting down, talking with them and becoming their friend.
In a nutshell this one man has probably done more to combat racism, than all the angry tweets on twitter combined.
Thanks for the link, that was an incredible talk, and that guy is cool as hell.
In some cases this is possible. The Klu Klux Klan is comprised of broken men who dance in costumes at night. What about the racists who do not do that? Who enact their racism as government policy? Or as housing discrimination? Or through their art?
How long will it take to reach them? To quote James Baldwin^[1]:
> You always told me it takes time. It's taken my father's time, my mother's time, my uncle's time, my brothers' and my sisters' time, my nieces' and my nephews' time. How much time do you want. For your progress.
Exhibit A: Gandhi
Fred Rogers and Carl Sagan are standing at the front of a very long line of people who are waiting to gently disagree with you.
I guess if I had to refine my original claim: it's impossible to politely disagree with fundamental societal values.
Tell that to Gandhi, tell that to the many people in the Civil Rights Movement and Martin Luther King, tell that to the people who were in the Monday demonstrations in East Germany, the list goes on.
His demeanor was polite, but his impact was rude and abrasive to many (racist) people.
Her e-mail identifies that you can speak on racism and sexism as much as you want, but all of your speech will be routed to /dev/null.
I think the fact people need to go through HR to give Feedback means the speech isn't going to /dev/null. People seem to take her speech very seriously and don't want to feel her wrath.
In fact, Google even appeared to take her concerns onboard after she got a lawyer and only threatened to sue. She just seems to expect more which is the entitlement I was talking about.
This behavior also enables racists and sexists.
If you start attacking people who previously had no problem with you, grouping them as evil on the basis of their physical characteristics, you’re going to get various forms of backlash. One of those is going to be those people seeking support among others belonging to the evil group identity that you carved out for them, and they’re going to push back in kind.
I don't think that happens very often outside of the villain origin stories in comic books. A normal non-racist person doesn't react to being called a racist by becoming the biggest racist they can just to spite people.
And racism isn’t binary. You don’t have to be pushed all the way to wearing KKK garb to have some level of contempt or prejudice towards other races. So a great way to avoid this outcome and minimize exacerbating existing tensions is to not engage in more divisive hostility on the basis of their identity. Like the guy she is berating likely didn’t even consciously realize he was white until she made a point of reminding him in the worst way possible. A dumb, counterproductive strategy.
But her behavior is going to make it harder for all other black people to get hired. People who are otherwise not concerned with race or sex at all will see this and then need to convince themselves that she is not representative of most black people. Some will undoubtedly just go with the option that seems like it carries the lowest risk to them personally and professionally.
Personally I would not hire anybody who has a history of trying to weaponize twitter. And being smeared as a racist, like she is doing to Jeff Dean, can be extremely damaging and severely career limiting. He’ll probably be ok, but it’s something that many people can never move past, especially if Vice or Vox or Salon or whatever culture war libel vehicle decides that they can twist your story into a hot hit piece.
The problem is that if you focus on race, gender and/or sexual orientation as an important factor underlying interactions, if you're not careful you can soon come to see race and gender as the primary driving force that dictates the outcomes of all interactions, and soon all issues get reduced down to a matter or racial, sexual, or class struggle.
The problem is the real world doesn't work that way, it is a complicated interacting network of events that are often only 2nd or 3rd order events from other completely different decisions made long ago.
To try and reduce all interactions and societal problems to a matter of a 1 or 2 factors is like trying to make money on the stock market solely by looking at the Fed's monetary policy. Sure the Fed's monetary policy is an important overall factor, and in some cases the most important factor in certain changes in the stock market, but that doesn't mean that there aren't a thousand other moving parts to focus on.
The problem is when we interpret every event through a single filter, or give one filter primacy in all interpretations of events that filter now colors everything we see.
So for example if my primary filter for understanding the world is race relations and/or critical race theory, any time someone disagrees with me I really do feel as though it is a racially motivated attack. Why? Because I have chosen to interpret everything in my world through the filter of race, and every event that occurs will in my mind be race related.
Note this applies just as well to any filter, christian extremists will interpret all events that happen as a sign of the times and the devil coming to power. If my filter is the class struggle than I will see every issue be between the haves and the have-nots.
My point is not to discredit people that want to bring gender and race in to everything I think there are many discussions where examining the role these factors played is important. My point is to caution and warn against getting into a single filter mindset, that is the cause of much of the divisiveness we see, we have people that really are living in totally different worlds because the way they choose to view the world is totally different and they refuse to ever consider there might be other filters to view the world through.
Anyone noticing the irony of this seeming to be pretty much what the paper author seems to be blaming the machine learning systems for ?
Or let's cut to the chase, you saw the headline, and your immediate conclusion was this was a raging SJW. Why did you jump to that conclusion?
These days I see a lot of both. I also have no idea what happened in this specific case, and at this time I wouldn't be willing to take a side.
You say "people with those types of built in personal issues float to the top" aren't you implying their positions are not earned based on merit and, therefore, that they are less competent than their peers?
It’s also possible that some promotions/hires are based on desired political appearance of the company. Promoting someone based on certain race and gender types ironically makes your company seem less racist and sexist to the casual outside observer.
In the high-dogma arena there’s incredibly easy and visible signals that give you the ability to appear like “one of the good ones.”
I think coincidentally this is highly attractive to elite circles too. Follow all the social justice rituals and shibboleth and you suddenly get the camouflage of an empathetic, good person.
If a person is indistinguishable from a good human being, isn't it actually a good human being?
Many are, yes. I had to hire one because my director’s bonus was implicitly tied to a diversity quota OKR, and the VP’s bonus was explicitly tied to one, which he blogged about as a shameful virtue signaling PR exercise. They didn’t even interview her. Then we way over-leveled her to boot, because there was another stupid OKR to grow diversity among senior levels. And this was at a big tech company that you’ve definitely heard of.
This is happening at many companies who claim that they aren’t lowering the bar.
Truth be told I had already lowered the bar and wanted to pass her but still couldn’t justify it. I didn’t want to deal with the diversity police and had my fingers crossed that she would be the one.
Some perfectly capable white guy didn’t get an opportunity as a result.
The picture insiders paint is that of organizations infested with technically mediocre people who form cliques that provide air cover for each others mediocrity ... with sex and race providing a disincentive for management to take action.
I wonder how accurate that is ... one explanation for the stories could just be that a lot of disgruntled males are unhappy with competition.
On the other hand, if it was true and I was a high performance underrepresented minority, there's no way I'd go to Google. Wouldn't people just assume I'm there because of quota filling, instead of my actual performance?
After 2012 we got a diversity hire on our team who was useless in every way, was a pathological liar and manipulator, yet who was consistently rewarded because the bosses boss was a female feminist. Her boss knew she was trouble but could do nothing. I did encounter a few more cases where female employees would just inexplicably have skills gaps that shouldn't have happened at Google, like not knowing what hexadecimal was.
I never encountered grumbling about competition. Google was not a hugely competitive place at that time because there was more than enough for everyone. Promos were generally not quotad, for instance, at least not for most of the rank and file.
I was a high performance underrepresented minority, there's no way I'd go to Google. Wouldn't people just assume I'm there because of quota filling, instead of my actual performance?
If you were genuinely high performance then no, of course people wouldn't assume that. And sure you'd go to Google, because they pay very well.
The real issue and it's not at all Google specific are the minority low performers or outright troublemakers, like Gebru. Then people absolutely assume they are quota filling. They go anyway because they aren't self aware enough to realise that's happening and blame any lack of respect they get to racism/sexism. And the money is still great so why wouldn't they go?
https://twitter.com/ylecun/status/1275162528511860737
Whatever your position, Yann engages on substance, and Timnit is obnoxious:
https://twitter.com/timnitGebru/status/1275191341455048704?s...
https://twitter.com/timnitGebru/status/1275191515380215808?s...
Basically the worst of online discourse, but in this case one-sided. Yann is discussing in good faith and Timnit is not.
If this is the normal way she interacts with people she disagrees with it's no surprise they didn't want her to stay. The public tweeting about it doesn't inspire much confidence either.
https://slatestarcodex.com/2014/02/23/in-favor-of-niceness-c...
For what it's worth, I and many others disagree with this characterization. I find Yann comes across as incredibly condescending and holier than thou in their interactions. Nor does Yann engage on substance. He refuses to take the time engage with, or even acknowledge that he has read, the relevant academic literature (which Timnit repeatedly cites).
I see a quote tweet from Timnit with "I'm sick of this framing...listen to us", then misquoting what he said. Ignoring his replies and then following up with "I'm disengaging for my sanity...not worth my time...Maybe your colleagues will try to educate you..." etc.
She attacks him (so he replies) and then she ignores him and talks down to him.
I don't have a dog in this fight, I'm just an outside person reading this - I suspect most people reading that thread would think Timnit's tweets are obnoxious. Imagine if the people were switched.
I wouldn't want to work with someone who argues that way when they disagree.
That doesn’t make all positions equally valid.
Stating that others disagree seems like a banality?
Obviously this is the case, just look at this thread and Twitter.
I just think they’re wrong.
I think attempting to explain why I think the way I do is kind of the point of the discussion. If I can’t justify it then I’d want to change my mind.
I appreciate that you've explained your reasoning for your position, though.
At some point you lose the assumption of good faith, and deserve to be called out for refusing to learn.
For what it's worth, I'm well aware of who Yann is, and was at the time as well. That doesn't make him immune to being wrong. (Nor, by the way, do I see any bad faith in her initial tweet. I see exasperation, but not bad faith).
>You can’t just reduce harms caused by ML to dataset bias.
She's already attacking a strawman right there. Yann did not deny any harms caused by ML.
Do you think Yann knows 100X more about every area of ML then everyone else, or is it just fairness, accountability, and transparency that he happens to be more knowledgeable in than arguably a founder of the subfield?
It's rare but I have encountered people outside my field who knew more than I did about my field, because of their daily experiences over decades, or their raw intelligence. Yann seems to have both.
Because I'm only a dilettante in the AI ethics space (and admittedly ML as a whole), and I can describe the flaws in Yann's reasoning. Blind deference of that level isn't rational.
I don't agree with your assessment of his "Reasoning".
Timnit brought up harms first, then pretended Yann did marginalize such harms and attributed them solely to a biased training sets. And then viciously attacked that strawman. That's a bad faith argument.
I can appreciate that she might have been indeed generally sick and tired as she writes, and can appreciate that sick and tired people will not always manage to be nice or overcome their own biases and assume good faith all the time from the other party; we're all human after all. But that doesn't change anything about her argument being made in bad faith.
This feels like unreasonable semantics. The dangers are precisely the danger of causing harm. The harms therefore are concrete results of theoretical dangers manifesting. They aren't different.
> In particular Yann did not suggest in any way a) there are no harms
I agree, and I've said as much.
> b) that harms are only related to biased training sets
He did, insofar as he suggested that the dangers were due solely to bias in the training set, which is implied when he says that if you train the same model on different data, everyone looks African. Like yes, that is true, but it doesn't reduce the harms (or dangers, if you want to be precise). It just creates a different set of biases with a different set of potential harms (which again, are "dangers").
I'm not seeing a strawperson.
What happened to diversity of thought, academic freedom, free speech as a civic virtue and not simply a restriction on government action, and all those other things this community normally stands for? Just yesterday we saw the NLRB rule that Google had illegally fired workers, and we were talking about how the big tech companies use their power to suppress internal dissent and it's bad. How did we forget that so quickly?
If you're anyone else in the company and think a problem could possibly work out, try to amicably work it out. If you believe it to be impossible to work out, it is much better to just resign than to threaten to resign, which will almost always result in firing.
If you resign, you have the upper hand, can still get 2 more weeks of pay, possibly a couple of good recommendations for your next job, and then go write your blog posts after that.
>Do you know what happened since? Silencing in the most fundamental way possible.
"Silencing in the most fundamental way" to me means physically clapping your hand over someone's mouth or murdering them, neither of which I believe she actually meant. This email would have greatly benefited from peer review.
Interesting. Having been on the receiving end of a (later proven to be bogus) HR complaint, this is exactly how it was handled. I was forced to respond to allegations where neither the allegations nor source were ever shared with me.
At the same time, the narrative that someone above her in the management hierarchy decided to pull her research seems more plausible. In that case, I would tend to "Privacy for the Weak, Transparency for the Powerful." What you describe is the former, but this would seem to be a case of the latter.
First, for this to be a valid case of HR protecting someone who needs protecting, these complaints would have to come from someone who Gebru was managing and therefore have leverage on. I don't know the specifics, but it would stand to reason that she did manage some people, so that possibility can't be excluded for sure.
But from the last paragraph it seems that she did actually try to address the points raised:
> You write a detailed document discussing whatever pieces of feedback you can find, asking for questions and clarifications, and it is completely ignored.
I wasn't there, but simply not addressing counter points doesn't fare well in the public's (read: my) eyes.
How is it fair or standard to make someone retract a paper because of anonymous and secret criticisms that the researcher isn't even given a chance to address?
The reasons Jeff Dean cited in his email for the retraction sound like things that could've been fixable.
Based on that I assume that the author was soliciting guidance from PR & Policy but didn't receive any. Someone higher up isn't doing their job effectively.
>That's how it is supposed to work. The thing that sucked about it was that it was impossible to defend myself. I only found out details after the fact because the complaint was anonymously filed on behalf of a co-worker and it was the co-worker that later came to me to explain.
[1] https://provost.uchicago.edu/sites/default/files/documents/r...
How, exactly, is it supposed to work? If you are asked to respond to allegations, yet those allegations are not shared with you, what are they actually asking you to do?
It's like you have good Silicon Valley espisode just from that, I'm not sure if I buy total innocence here.
Are you sure? Even primary school bullying is better, at least you can see the abuser.
EDIT: a bit more info from the NYTimes: "In an interview with The Times, Dr. Gebru said her exasperation stemmed from the company’s treatment of a research paper she had written with six other researchers, four of them at Google. The paper, also reviewed by The Times, pinpointed flaws in a new breed of language technology, including a system built by Google that underpins the company’s search engine." https://www.nytimes.com/2020/12/03/technology/google-researc...
my original comment was only targeted at the treatment of the (accused) abusers by the corporate HR, nothing with any specific person
I wonder what People Ops is, something more about logistics maybe. Still paid by the company, so it can't be on the side of employees.
Fortunately, said person accidentally admitted to doing it, after changing their story a few times, and was summarily fired.
What strikes me is how out of touch she seems to be. We're in the middle of pandemic and millions of people are out of work. The worst economic downturn since the Great Depression. However, due to luck, her credentials and research, she has been able to continue working for one of the top companies in the world and is even able to take a vacation. Good for her.
And yet, while on vacation, she makes demands of her employer that perhaps she was aware they wouldn't/couldn't meet.
I'm stunned by the if you don't accept my conditions, I'll deal with you, when I'm good and ready, when I get back from vacation. Like, how out of touch and tone deaf is this?
Anyway, the first thing she does, after rage quitting, is to run to Twitter to complain. She even said on Twitter that she didn't have a lawyer and wanted to find one ASAP. Honestly, everything Google did seems perfectly reasonable. Is her behavior unbecoming of a manager? Based on what I saw on Twitter, I'd say 'Yes'.
I had been following her on Twitter and saw this pop-up last night. It was kind of confusing and seemed like it was going to become very annoying, so I unfollowed. Then today, it kept showing up in other people's feeds, so I blocked her and muted people who retweeted her.
There is such a thing as a "brilliant jerk" and usually companies keep such people around too long. Seems like Google decided this headache wasn't worth it, and cut her loose. But now we see a "brilliant jerk" who is female and a minority/POC.
This conclusion seems so non sequitur to the argument. There is literally nothing in the previous argument to suggest that any of this was motivated by anything other than a disagreement with the report. The argument presented by the researcher is conjecture. Coupled with the fact that she threatened to sue her employer and they kept her for a year? Any reasonable employer would see that her employment is a liability and dismiss her prior to a year.
In the world of business, there is no jewel too precious to discard.
Plain English translation: she didn't present the results of her research in a light that favours the company's goals.
Once in a while someone posts an article on HN about academia and how doing a PhD is badly paid with few opportunities for stable employment. Then the comments will wonder why people still bother with academia.
Well, this is why. Because, as a rule, if you are a researcher in academia you won't be asked to retract your research because it makes someone look bad.
If your results go against current dogma, or if they reveal an uncomfortable truth, your paper will be rejected for spurious reasons every time you submit it. A recent example from Glenn Geher[1]:
> I have published more than 100 academic pieces in my career to date. I've pretty much been through it all.
> From this context, I will say that the most difficult paper that my team (the New Paltz Evolutionary Psychology Lab) and I have ever tried to publish was a paper on the topic of political motivations that underlie academic values of academics.
That's the pushback you get for researching political motivations in academia. It's much worse if your ideas directly connect to social policies. If your ideas are particularly heretical (or you engage in good faith with heretics), you'll have your life threatened by violent mobs. This has happened to Allison Stanger, Bret Weinstein, Jordan Peterson, and many others.
1. https://www.psychologytoday.com/us/blog/darwins-subterranean...
>> Each rejection came with a new set of reasons. After some point, it started to seem to us that maybe academics just found this topic and our results too threatening. Maybe this paper simply was not politically correct.
It looks like the only reason to believe the reasons for rejecting the paper were political is that it was rejected by many venues. Note that having different reviewers give different feedback is par for the course.
Personally, I don't think this is serious. Having one's paper rejected, stings, but it happens to everyone and all the time. There's no reason to see hidden motives behind it. The paper not being very good is sufficient explanation.
Not that it doesn't happen for papers to be rejected because they threaten a reviewer's work. But to claim that the entire academic establishment is threatened by a paper and that's why it was rejected? Sounds a bit far-fetched.
Not entirely accurate (worked in academia). If your research makes someone look bad or have a chance to jeopardize financing, usually you won't get a chance even to send the paper, because it will be shut down in your research center by either your mentor or other peers.
Sound mentors are well connected with publishers, and even if you somehow send it under the radar (which will be the end of your research career), someone will call either your mentor or management for confirmation.
> she didn't present the results of her research in a light that favours the company's goals.
The same is happening in academia, but let's not open Pandora's box :)
Actually, I really can't think of how my advisor would tell me not to publish a paper, except to suggest that it's not ready for publication.
But perhaps, as is often the case in these conversations, we're talking about different "academia"'s? I think there are differences between fields and between different countries' institutions in the same field etc.
It would be great if this were true. But it isn't.
https://medium.com/@leej12255/the-threat-to-academic-freedom...
Mostly, I see in the article an attempt to engage in the usual online culture war, but I can't say what is reported in the article is making me concerned about academic freedom. To be honest.
I have experienced exactly that, in academia.
People invested in identity politics are, by their own admission, interested in outcomes. In this world view, the legal system is a tool for achieving the desired outcomes. The same set of rules can be illegal if it rejects certain identities in a context, and at the same time legal if it promotes those identities in a different context. 'Heads I win, tails you lose', but dead serious.
A thread discussing the pervasive 'women and minorities encouraged' mindset is in western academia:
https://academia.stackexchange.com/questions/95011/is-it-con...
The squeaky wheel gets the grease, but it still bothers me that people like this get highly paid positions to point out problems seemingly without any technical knowledge. And then she's delusional enough to think that she can misbehave and make ultimatums?
The article links to a "landmark study" that shows that black women are underrepresented in training datasets and therefore misclassified more. Sure, that's important to fix, but it sounds like an undergraduate project, and it's not something I would call AI.
You are making a lot of (wrong) assumptions here. Not too many Stanford PhDs are graduating without technical knowledge
I have however seen way to many doctorates that seem technical while they're not. There's a common theme in her career, and it's not necessarily technical knowledge.
She worked at Microsoft research, sounds really impressive. But it was in the "Fairness, Accountability, Transparency and Ethics in AI lab". which sounds like a PR stunt. Her research was supported by Stanford DARE fellowship, which is mainly concerned with increasing diversity. She was an AI researcher at Google, but it consisted in pointing out bias in datasets. Her PhD research[1] was using street view images to find pick up trucks and finding a correlation with republican voters, which sounds more like a sociological application of computer vision than a hard technical problem.
You have to complete all the requirements and TA grad classes after all.
Here are some FAT papers I've enjoyed: https://arxiv.org/abs/1806.08010 https://arxiv.org/abs/1802.04023 https://arxiv.org/abs/1803.04383 (won best paper award at ICML 2018)
Many FAT papers are published at NeurIPS or ICML (generally considered top two machine learning conferences). There's also a conference just on the topic: https://facctconference.org/
I have determined from your condescending tone in this thread that you do not have technical skills. See? Doesn't feel good or make much sense!
>But now there’s an additional layer saying any privileged person can decide that they don’t want your paper out with zero conversation.
Decisions in megacorporations are made in one direction, from the top on down. If this is her main point of contention, I sympathize but that's what you get for joining one of the largest corporations in the world. It seems both parties will be better off without each other. I hope her research won't suffer for it.
of course it will. The big tech companies have created networks of users and user data that is beyond anything that can be replicated in an academic or laboratory setting. By saying that it's fine for corporations to have draconian oversight over research about the systems they build, what you are saying is that these systems cannot be researched for any purposes other than to make them more profitable. That is an abdication of responsibility.
I disagree because I don't think Big N has exclusive access to the data necessary for cutting edge research. You don't need petabytes of data to train cutting edge neural networks.
It also seems she published the paper she is best known for before joining Google, suggesting academics are not submitting subpar research compared to Big N.
Unfortunately enacting change "from within" isn't always easy. It's easy to forget that Google AI still sits underneath the megacorp.
Her role is specifically created to hold her employer to account when they are using bad practices. Her opposition to particular policies enacted in the company is literally part of her job description.
Only highlighting issues without power to enforce anything is not enough to have any tangible results? That's for sure.
But she was not the CEO.
And that's why at some point you need labor unions (not saying high paid tech workers needs them) and at some other point you start considering stop being an employee.
"after all the micro and macro aggressions and harassments I received" "does it just happen to people like me who are constantly dehumanized?" "Silencing marginalized voices like this is the opposite of the NAUWU principles which we discussed" "the next day I get some random “impact award.” Pure gaslighting" "Writing more documents and saying things over and over again will tire you out but no one will listen."
I’ve been at companies where I’m faced with an approval process before publishing research to the outside world. It can be quite stressful, especially in the face of holidays and impending deadlines.
However I guarantee that if anyone had a problem with the work, they would take the time to tell me why.
And it would happen without untitled meetings or unrelated email drama.
They might even work with me to fix the problem because they’re my coworkers and that’s what it means to work together in a normal workplace where people respect each other as colleagues.
Sadly every piece of publicity related to Google and its workers makes me want to work there less and less...
"withering email" == "anger-fueled message sent by a manager to a large group that asks readers to ignore company policy and start arguments with other leaders"
I don't see where "ethical AI researcher" comes into play here. Instead, I see a leader at a company unprofessionally sending messages to a large listserv and is later fired.
What am I missing?
In general, if I hear "withering e-mail" without context, I imagine an e-mail sent between two parties (or at most, a handful) where one party is cutting down the other directly. When I hear that an employee was fired for a "withering e-mail", I immediately think of retaliation.
In this case, "e-mail" is almost inconsequential. This "e-mail" was a broadcast to hundreds of people who were not in any way involved with the subject matter. It was "withering" in the sense that it cut someone down, but the person/company it cut down wasn't even in the TO field.
Words matter. I now notice that the post title is changed to the much more neutral "AI researcher Timnit Gebru resigns from Google".
"Google silences minorities/women/AI researchers" is way more interesting/important than "Google/AI researcher did/didn't misbehave."
It isn't really clear with your first quote if one thinks that silencing people generally is okay, but not minorities/women, or if silencing anyone is never okay, or if the minority/woman was silenced merely for their demographic status.
She wasn't fired. She said she'd resign if they didn't meet her conditions, so the accepted her resignation. She's being disingenuous.
We should hire by skill alone whether the person is a Lesbian Black Female, or a White Male
Another argument is that it's necessary to be discriminatory in favour of minorities to level the playing field.
I share your opinion, but not everyone does.
In this case, I'm not going to respond in much detail, other than to note that there are 30+ years of writings about affirmative action which get deeply into this issue. Your summary of it is misleading and incomplete.
It's a hell of a lot easier for a white male to pick up those skills because of culture and society than it is for most other groups of people.
I think there's a lot that can be done to help minority groups succeed and I'm a little less concerned about what's "fair" to white males like me.
Since you can't actually calculate someone's skill, all you can do is hire on an attempted measurement of skill. And if you find reasons to think that your measurement of skill has inaccuracies, you'd probably be better off taking that into account when evaluating a candidate.
But tech companies want to talk to the humans they're hiring, so race and gender are (almost) always available as information inputs during the hiring process. There's no equivalent to the curtain to remove the possibility of bias, so you need to look at alternate methods. Setting hiring targets is one way to do it. If you're going to complain that the targets are unfair, you can't just say "Well shucks, guess we have to stick with the system that produces massively unequal outcomes." You've gotta propose a system that's less unfair than the status quo.
Other companies have tried. Names and vitals deleted from resumes before any people involved in the hiring process see them, remote interviews conducted over IM or with voice masking. That's one benefit I see with the much-maligned leetcode-style interviews, is that your identity is completely isolated from the process until the very end.
That's assuming people only know their clones.
This is actually kind of funny to me, because in the open source world plenty of people have extremely productive working relationships without ever seeing or hearing each other, and in many cases without even knowing what country the other person lives in, how old they are, or what their legal name is.
So while there are definitely arguments that face to face communication is "higher bandwidth" or has other advantages, it doesn't seem out of the question to me that the hiring process could be "blinded" to a similar extent to orchestra auditions, without any significant reduction in hiring accuracy.
(Ok, maybe not quite the same extent; language fluency and style of speech are still significant signals even if everything is done over text)
There's no reason you can't do an interview over text-chat instead of in person -- hell, with most of us working remote for the foreseeable future, that's how the majority of on-the-job communication will happen anyway.
Be careful here, the wind has changed and blind auditions are now problematic.
https://www.nytimes.com/2020/07/16/arts/music/blind-audition...
The argument made in the article you cite is ludicrous, blind auditions cannot possibly hurt diversity. If there is a problem when blind auditions are used in hiring for professional orchestras, the problem is elsewhere in the pipeline, and the way to fix it isn't replacing blind auditions, its fixing issue further up the pipeline.
There may be a pro-diversity case for using something other than current skill as a factor at other stages of the pipeline which are intended as, in whole or in part, educational and where current skill is being used not as a measure of current professional competence, but as a proxy for potential. But even there that's largely a poor substitute for identifying and addressing the factors producing a skewed pool.
1. I think few companies are out there "hiring by race or gender". At most companies I know, affirmative action means hiring by skill, but making sure at least XX% of the hiring pool are women, black, etc. This really just means your resume is more likely to get seen and maybe you're more likely to get a first round, but not that "you're being hired by race or gender".
2. You could argue this is still unfair (although as previously stated, you're still hiring people who earned it based on skill). Unfortunately not doing anything would me more unfair, specifically by stagnating things in the problematic state they are now [1].
In the macro-historical context, white Americans brought African slaves to their country, and actively deprived of wealth and knowledge, right? That was a societal, conscious commitment to push these people down.
Now that they're free but seriously lacking wealth and behind on knowledge too, they're expected just create that wealth and knowledge themselves. Thanks to "unfair" institutions like public education, this is going to happen regardless, but very slowly unless there's a societal, conscious commitment to push these people up.
[1]: Having a huge chunk of your society be alienated not only socially but also economically leads to conflict, could worsen the gap instead of improving it, weakens social and cultural ties, etc.
Do you think it's possible that you can "hire by skill alone" and given two equally skilled people - one man, one woman - always hire the man, and that you could hire some equally skilled women if you randomised or removed whatever male-bias exists in your hiring?
Do you think it's possible that there are equally skilled men and women available to employers to hire, but that employers have built frat-boy workplaces where only men are interested in working, and cultures that drive away skilled women?
Do you think "hire by skill alone" means always hiring the most expensive people - like buying jewellery by value alone? What if a company can't afford to staff with all the maximally skilled people, but can get 80% of the skills for 50% of the money?
What about hiring people who can be trained or skilled up, and training them?
What about teams, where the collective skills can be greater than the sum of their parts, but maybe not if all the parts are identical?
It doesn't bother me if an applicant pool is made a bit bigger for marginalized people than myself, because I do not struggle to fall into any applicant pool whatsoever and have not for most of my adult life. Be it for employment, education, or housing.
Where conversations can get annoying is when I feel demonized because inequity exists independent of my individual actions. But I can live with someone bitching on Twitter because I'm not afraid of the police or telling potential employers I have a kid on the way.
What I don't like living with is the inability of others like myself in my own caste who would dismiss reality on reductionist notions "hiring by race or gender is inherently racist" without critical thought. Ignoring lack of diversity tacitly supports inequity and is itself racist or bigoted, by virtue of doing less than nothing to correct it.
How is this true? What if someone is a broke straight white man with three kids and someone else LGBTQ person of color is a young childless heir of fortune? How is the first person possibly privileged in comparison with the second one?
Looking from Europe, America seems to be very determined to recast its very obvious class problem as a race (or even gender) problem, even if it means introducing disadvantages based on immutable characteristics AGAIN. Two wrongs do not make a right and this farce will bite you again in the future, just like slavery and old style racism did.
That said, in the United States, non-white men were systemically marginalized and prevented from participation in society to the same degree. There are numerous examples of this over the last four centuries, but they did not decrease in fervor until about a generation ago. For many reasons, our class divide is correlated to our racial divide. That doesn't mean we don't need to fix both, just that the there are two problems to fix there.
Looking from America, it's hard not to be frustrated at Europeans on their high horses talking about class versus racial divide. Is it so hard to recognize that we have different social problems, and a different history? And that things we talk about might be colored one way, because race, gender, and sexual orientation impact real people on a daily basis? Do you reject the idea that bigotry exists independent of class and it's something we need to work on?
That is the Internet - Americans commenting on Europe, Europeans on Islam, Muslims on Israel, Israelis on India, Indians on China etc. The distance may make you wrong, but it also may make you notice more general outlines of the forest you are commenting upon, while the locals see only individual trees.
Theoretically, complex societies should be able to fix multiple problems at once. In practice, it is very easy for one topic to exhaust ALL the oxygen in public debate.
2020 was all about race and other immutable characteristics in America. Among all that, class problems such as enormous healthcare bills that destroy lives every day, are basically forgotten.
Of course that there are many facets of bigotry out there. But: would you rather be a black upper middle class than a white unemployed person without good marketable skills?
These days, I would say that the answer is very different from the KKK days.
While class problems do, absolutely, exist in the US, race problems also exist.
How fortunate for you. On the other hand, other people are hurt by the explicitly racist policies you endorse. You don’t speak for them.
> in my own caste
Why don’t you speak for yourself, instead of speaking for others and assuming they’re “in your caste”, whatever that means?
I am not sure how this may have influenced Google's decision in this particular case, but I imagine it was part of the evaluation. Other comments here delve further into her current and previous actions.
[0] https://www.lynchlf.com/blog/personal-liability-for-managers...
Maybe she's more mature than me, but they're probably not going to end up being super relevant.
Imagine being a senior researcher at the peak of your career, working for 6 months to a year on a paper, submitting it to a top tier conference, getting accepted, then getting the pointy haired boss do-what-I-said-peasant treatment.
Big nope.
And I've lost the link to the tweet.
I switched from IC to EM because I really love helping grow careers, but if I ever was put in Jeff Dean's position I'd probably quit immediately. No job is worth it.
I routinely run into the issue that if I try to understand why people did something that went badly/harmed people without looking to blame them per se, I get accused of being "an apologist." But in practice trying to understand why things happen is essential to finding a real solution. Merely asserting that X person's/group's needs matter and they are being harmed isn't really enough to find a viable path forward.
Like I have seen people say that suburbia is "White supremacist design" because in practice it ended up being mostly Whites who got suburban housing when suburbia was born in the US. I have tried to make the distinction that suburbia was born in part because large swaths of greenfield development was quicker, easier and cheaper to create and that this choice wasn't, per se, racist.
I am aware there was real racism happening and there were a lot of bylaws that intentionally excluded People of Color, but I'm sure those bylaws would have existed even if they had been building towers of condos in downtown areas instead. It wasn't specific to the architectural form that was built.
I recently had an exchange with someone that reminded me how important trust and mutual respect is and how the lack of such tends to cause problems to escalate.
I asked this person about a thing they did. I had been having paranoid fears that they did that thing in reaction to me and stuff I was working on and when they replied to my inquiry they had a wholly unrelated reason.
I didn't tell them that I was having paranoid fantasies that maybe this was some kind of negative reaction to me. I framed it neutrally.
Their reply was very reassuring to me. It was reassuring in part because I trust and respect this person. If you don't have that piece, having a long list of negative experiences makes it difficult to believe they aren't intentionally harming you and then lying about their real motives to cover it up and enable additional abuse.
It is, perhaps, a mistake to leave this remark. Like Timnit Gebru, I'm pretty tired and frustrated with a lot of things and feeling rubbed raw and exhausted.
But it seems to me it doesn't get better by throwing in the towel and giving up on saying anything just because the entire world is touchy after a nearly year-long global pandemic.
What feels like a breakdown of trust in society has been on my mind a lot recently. Without trust, it seems communication and collaboration becomes impossible. How can society solve any of its problems when people can't discuss anything about those problems or potential solutions without it turning into a fight?
I've been on Hacker News over 11 years. I would like to think I've been building bridges, but it seems like nothing I do is ever enough to reassure people I'm not some SJW Feminazi here to just piss on the guys and let them know what misogynistic assholes they are and it gets hard to keep trying when most of the community has watched me starve for years and openly told me "Not my problem. Get a real job." (while my writing hits the front page, but people don't want to support it financially, knowing I'm handicapped, etc).
I don't have a whole lot more to give and I've spent much of this year wondering if it's time to throw in the towel and leave HN. It feels downright abusive at times to stay in a community where I feel I have done so much to reduce sexism and open doors for other women and improve participation of women here and it's the funnel for a multi-billion dollar business, yet I remain dirt poor.
It's a rather jagged, bitter pill to swallow and I think I deserve a helluva lot better.
But then I don't know where I would go if I left. HN is the least worst thing. Other places are worse.
Metafilter was a toxic cesspit that banned me for supposedly "self promoting." They like to wrench their shoulder out of place patting themselves on the back for how what awesome, wonderful people they are and the mods were actively encouraging the membership to bully me at a time when I was homeless. One member of Metafilter that had a hobby of harassing me while I was homeless was a female ER doctor. Another was a very privileged American pursuing their PhD while living in Europe.
When you left your comment, I was staring blankly at some other open tab wondering how in the heck to talk about rape prevention and best practices for dismantling rape culture without using the word "rape" at all, in part because it's a triggering word for people who have been assaulted and in part because I get accused of being full of bull for thinking I know anything about such topics.
Some problems are just hard to solve. I do what little I can, which doesn't seem to amount to a handful of sand in the grand scheme of things.
I guess the upside is I'm mostly well at this point, in spite of the entire world telling me I'm a deluded fruitcake so it's not like I'm ever going to get taken seriously or given any respect.
And this is probably all the wrong things to say, as usual. I wish I had an answer for you. There doesn't appear to be one, as best I can tell.
I read her email. You know what's crazy about it? she is talking about Google silencing marginalized voices. She keeps referring to herself as a marginalized voice in the research community! She has a PhD from Stanford, working at one the best places in the world for AI researchers, and she gets more attention than almost any other researcher I know of (she earned it of course). Wake up woman. You're a privileged researcher! If I were making the comments she made to Lecun, no one would even bother to listen, yet alone Lecun actually respond and eventually leave twitter because of that. Give me a break. There's not even one sentence in her email about what is actually the content of her paper that is so controversial. It's just a rant about nothing. Welcome to the real world, companies have policies and once you join them you lose your freedom to do whatever the heck you want. You can go back to academia but no one would pay you what you've been making at Google Research.
https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter...
".. I'd like to ask everyone to please stop attacking each other via Twitter or other means. In particular, I'd like everyone to please stop attacking @timnitGebru and everyone who has been critical of my posts. Conflicts, verbal or otherwise, are hurtful and counter-productive... " -- https://twitter.com/ylecun/status/1277372578231996424?s=20
Yann later tweeted again to explain what he meant in the context of deep learning models without hand engineered features, but people ignored him and still replied he was wrong.
It looks like they were accusing Yann of all the systemic biases of society... common.
Is there a paper showing that the Transformers based models are "biased" no matter the dataset ?
I really enjoyed this deck of hers, which I found as a result of reading this thread:
https://drive.google.com/file/d/1rcG8KVmjRUWWNSg-R6cTBlAScP9...
"So if you would like to change things, I suggest focusing on leadership accountability and thinking through what types of pressures can also be applied from the outside. For instance, I believe that the Congressional Black Caucus..."
Skipping parts of the chain of command to deal with grievances is usually a toxic behaviour. Trying to skip the entire corporation and going straight to the government counts too, IMO. This woman has opportunities, abilities and successes that most of us can only dream of and she's using that to try and make Google a vehicle for political goals not quite articulated here (this email is obviously not written for public consumption, it is light on specific details apart from her thinking there are insufficient women hired). I can see the complaint against her, she's already got an advantage in life and now she's using her access at Google to try and strengthen her hand and weaken that of her coworkers.
Not if you've already attempted to escalate up the normal chain of command. In such cases it's often considered morally required.
When I view Gebru's Twitter argument with Lecun throug the above lens, it is pretty obvious to me that she is behaving in a toxic manner.
In that fracas, she emphasizes emotional appeals and "you just need to listen to us" and "I'm so sick of this". She also takes a page from the AOC school of argument where you (the rhetorician) play the meta-game where you judge who is allowed to participate in discourse (hint: everyone who disagrees with me is excluded!). It's a useful trick, for once you have purified the field your arguments will easily win.
Lecun later offered an olive branch and apology, but, true to form, Gebru doesn't offer any hint of awareness that she also may be responsible for the toxic devolution of the conversation. She personally blamed Lecun for her getting trolled, whilst failing to acknowledge that he was also being trolled by her supporters.
Later, and separately, when Google calls her on her resignation bluff, she employs the "call out" tactic, where she accuses Jeff Dean of personally firing her in an obvious attempt to shame him. This whole affair reeks of a PR play (and thus, not acting in good faith). That, to me, is highly toxic.
Critical theory is useful for the purpose of study and quantification of different social bias, norms, tends, values, or whatever other social aspect you want to slice up. The problem is when people use those divisions to identify themselves. It forces people to identify with a certain group, when in reality the divisions are often not nearly as clear cut as they are defined. But over time people are pressured socially into moving closer to how their group is defined, and what may have once been a false dichotomy becomes a self fulfilling prophesy of sorts; where the social interactions are entirely defined by "my tribe" vs "their tribe". My tribe is all good, theirs is all bad, therefor we are justified in treating everybody in their tribe as less than human. Even is cases where there is very real injustice and evil taking place, allowing oneself to be defined by these groups does nothing to resolve the problem. It only serves to shore up divisions and conflict between groups, making it worse.
It is unfortunate that the admonition to "love your neighbour as yourself" is no longer held with high regard.
43 You have heard that it was said, ‘Love your neighbor and hate your enemy.’ 44 But I tell you, love your enemies and pray for those who persecute you, 45 that you may be children of your Father in heaven. He causes his sun to rise on the evil and the good, and sends rain on the righteous and the unrighteous. 46 If you love those who love you, what reward will you get? Are not even the tax collectors doing that? 47 And if you greet only your own people, what are you doing more than others? Do not even pagans do that? 48 Be perfect, therefore, as your heavenly Father is perfect.
Yea there is something uniquely activist academic about all these complaints you see surfacing nowadays.
As though millenials are landing in industry now and they're surprised their employers are companies selling products and not activist organizations.
And you're right it's even funnier when the people complaining are urbane academics from elite institutions outraged that they don't unquestionable authority to enact policy.
Like stigmatizing advocates of free expression, a general embrace of safety-ism, scream invectives until the bureaucracy buckles tactics, etc.
Is this now posted somewhere publicly?
I feel like most of this conversation is pretty speculative until the commentariat (self included) can read it!
EDIT: duh
https://www.google.com/amp/s/www.nytimes.com/2018/10/25/tech...
“ Google could have fired Mr. Rubin and paid him little to nothing on the way out. Instead, the company handed him a $90 million exit package, paid in installments of about $2 million a month for four years, said two people with knowledge of the terms.”
Let’s assume that’s true. What is worse behavior? Obviously his. Yet he gets paid.
It’s not an apples to apples comparison but if google was to say to anyone, “goodbye and don’t let the door hit you on the way out”, shouldn’t it be this guy and the other dudes mentioned in the article?
And IMHO the fact that they didn’t is a great example of systemic sexism in action. So it’s not unreasonable to wonder if similar forces played a role in this situation.
It’s not surprising that companies function like this but that doesn’t make it right, and, it doesn’t mean that (even though change is slow) it isn’t possible to change norms.
We don’t know the full details; Googles firing of her may be valid.
But to be as dismissive of her being a representative of marginalized groups, and facing prejudice (conscious or unconscious) herself, is wrong. IMHO.
In the email Jeff writes that the paper she wanted to submit conference review system did not meet Google's internal review standards.
To me this looks really fishy! I did not read her work, but Google has conflict of interest in publishing this paper? If the paper is so out of date as Jeff writes, it will get rejected in conference review system. Reviewers are known for being brutal..
Perhaps she's right to call out BS here, probably not the way she did.
Granted, because the process she described is anonymous and opaque by design, it could have happened to other people at the company and only they, HR, and the people requesting/ordering the retraction would know about it. At the same time, if that's the case, then Google needs to stop that, because it looks really bad, especially when it involves a minority researcher who published a paper on how certain models Google uses may have some degree of discriminatory bias built into them.
Imagine this: You’ve sent a paper for feedback to 30+ researchers, you’re awaiting feedback from PR & Policy who you gave a heads up before you even wrote the work saying “we’re thinking of doing this”, working on a revision plan figuring out how to address different feedback from people, haven’t heard from PR & Policy besides them asking you for updates (in 2 months). A week before you go out on vacation, you see a meeting pop up at 4:30pm PST on your calendar (this popped up at around 2pm). No one would tell you what the meeting was about in advance. Then in that meeting your manager’s manager tells you “it has been decided” that you need to retract this paper by next week, Nov. 27, the week when almost everyone would be out (and a date which has nothing to do with the conference process). You are not worth having any conversations about this, since you are not someone whose humanity (let alone expertise recognized by journalists, governments, scientists, civic organizations such as the electronic frontiers foundation etc) is acknowledged or valued in this company.
Then, you ask for more information. What specific feedback exists? Who is it coming from? Why now? Why not before? Can you go back and forth with anyone? Can you understand what exactly is problematic and what can be changed?
And you are told after a while, that your manager can read you a privileged and confidential document and you’re not supposed to even know who contributed to this document, who wrote this feedback, what process was followed or anything. You write a detailed document discussing whatever pieces of feedback you can find, asking for questions and clarifications, and it is completely ignored. And you’re met with, once again, an order to retract the paper with no engagement whatsoever.
Jeff Dean's response about mitigations being made to minimize the issues she highlighted could be justified too, but again, because the process she described is opaque, no one external to the process has any idea about the merits of the arguments raised.
"Does that sound like a standard procedure to you or does it just happen to people like me who are constantly dehumanized"
She is not happy with the process and she is taking it personal. She was hired as a lead researcher and manages a big group and project. She has the nerve to say she is constantly dehumanized? 99% of Google employees would want to be in her position.
Google is a big company with many good but also bad processes and policies (I never worked there). Instead of trying to make change she starts wars. Her thing with Lecun was exactly the same. The funny thing she said she hired a feminist lawyer to sue Google a year before! She still kept her job after that. What company does that? She is lucky she had an employer like Google.
I think she feels marginalized because the process she's going through is dehumanizing, especially given the topic she wrote about (bias in AI frameworks).
It's possible that 99% of Google employees would want to be in her position, but I think that's a bit high. I imagine even fewer would to be there after going through what she goes through, especially racism, which sucks.
I can see how you would think she's confrontational. I think she is to some degree, but I don't think it's unfounded.
She's a minority, and as such, has to deal with all of the explicit and systemic racism that's present in the US. She believes that there are intrinsic characteristics associated with the AI models used at Google that perpetuate the racism she has experienced. She was able to write a paper about the defects she believes were present in those models, which apparently passed whatever initial review processes are present at Google. Not long after that, someone at Google didn't like her paper and, through HR, used a "review" process, which isn't really a review process because there's no mechanism for her to discuss/debate anything with the reviewers, to effectively order her retract the paper under the guise of an anonymous review.
In effect, Google may be perpetuating racism indirectly via problems with their AI models, and directly by silencing her work via a process that sounds like a peer review, but is really just a way for someone to anonymously order her to retract her work.
I'd be angry too if my work implicitly supported frameworks that discriminated against me, and when I submitted valid criticism of those frameworks, my work ordered me to retract it under the guise of some anonymous review process.
However, you really should read https://abc.xyz/investor/founders-letters/2004-ipo-letter/
Anyone who recalls this letter should be able to muster sympathy for those who have joined Google with an activist mindset. Google is supposed to be different. Google is supposed to be for people who want to make the world better. Sure, maybe it's all just so much branding, but this is how Google (and by extension many Googlers) styles itself. This news is more evidence that Google is really bad at living up to that image - as idealistic/lofty/unrealistic as it may be - where it counts.
And any way, Timnit isn't toxic. She is upset with the status quo of equity among genders and ethnic groups in her field, and she is fighting to improve it. This is naturally unwelcome - and perhaps comes off as combative - to anyone who is satisfied with the status quo, but I would not call it toxic.
Did you see Jeff Dean's email they just added to the article? Not surprisingly, she is doing the same thing. The reviewers are not agreeing with her and she is shocked how someone dares to reject her paper. She starts making demands to reveal who that was and sends an email to the Women AI list like it's some racist attack against her because she is a woman and black researcher. That's a toxic behavior of a very arrogant researcher. She clearly expects to get some preferential treatment because she is a big shot researcher or she just thinks she is smarter than everyone else. The irony.
Where I come from, behavior like this is interpreted as - at worst - iconoclastic when exhibit by white, male leaders. I have found that it is rewarded more often than not when it happens in places I have worked at in the past.
Also, just read some of her Twitter mentions - the fanboy harassment is real.
The sad part is that social media, like always, focus on her race rather than the details. Here's an example tweet from Jeremy Howard, a known researcher (114K followers) from fast.ai:
"Whatever else you think of Google, you gotta admit their crisis PR response is staggeringly incompetent.
The day they were found to have illegally spied on and terminated activists - they picked that day to fire their top AI ethics expert (a black woman)."
He completely ignores the most important thing - why she got fired. He calls Google PR incompetent because they fired a famous black woman researcher after what happened. You see, people expect that Google would check their employees' skin color and gender before they decide to fire them. The content is not important.
From the Jeff Dean email it seems like the "cross-functional team" (read: includes people who are focused on company's bottom line, not the subject matter of the paper) wanted some sort of "fair balance" when discussing AI. He cites some examples.
Does this mean if we review papers on AI from Google employees that Google has approved for publication in the past, we will consistently find this balanced view.
It seems likely that both sides are mis-characterizing events in pursuit of their own goals -- which to me suggests a general environment where parties are tending not to communicate with the goal of arriving at agreement -- but rather as adversaries.
Hackernews will of course assume that the only reason for an adversarial relationship in this scenario is "cancel culture SJW memes" and other "deemed toxic" trends for which the minority voice is almost always the only guilty party.
I think that level of dismissal is unwarranted as it seems pretty likely to me that there is a definite gotcha-oriented communication style coming from the google leadership here -- which very well might reflect an intentionally or unconsciously adopted strategy to create obstacles for voices of disagreement like this.
Said hires have thus far, as far as I can tell, not produced anything of substantial value to any of these companies. They nevertheless become increasingly emboldened and misinterpret their situation. After all, no-one dares criticise them, they are showered with feel-good publicity. The only thing they need to do is keep their end of the deal.
Until they overstep, get fired, and cause drama by claiming everything that happened to them was due to discrimination, and not because they are toxic and disruptive.
I think this is all a good thing because it may alert some executives to the price for hiring activists into research roles.
Edit: Should add that I am purely talking about the power dynamics here, not research impact or the question of whether AI policy is an interesting subject. It is, I am just observing that it has not driven particular value to companies when compared to the negative publicity these dramas cause.
>Said hires have thus far, as far as I can tell, not produced anything of substantial value to any of these companies.
These two statements are at odds with each other.
I mean, from the tweets what I gather is she wasn't planning on leaving just yet. Saying "hey, you want to resign by [X] but we'd rather you be gone so let us inform you've just been resigned as of now" is essentially firing [1].
> Offering to resign was a huge mistake.
I think this will be good for her in the long term. I'm sure she'll find another research position, and the alternative was betraying her convictions or just the huge burden of constantly being worn down by Google.
[1]: https://twitter.com/timnitGebru/status/1334364735446331392
[1] https://twitter.com/timnitGebru/status/1334353073012158464
I mean, yes. It's an unfortunate reality that ethics are often at direct odds with the unrelenting pursuit of business value. For a big tech like Google, by caring about people and the impact of your technologies, you will almost surely sacrifice profits in the short term.
So then the question is: people or profits?
Who determines what value a business gets assigned?
Edit: And to be clear, her most cited paper (> 1000 citations) had an impact on what some companies did: https://www.theverge.com/2020/6/8/21284683/ibm-no-longer-gen...
What is disturbing here, from a researcher's point of view (even within a company!), is the lack of transparency on why a paper is being blocked from publication. The implicit understanding of being a researcher in a company like Google is that, while papers are subject to review prior to submission/publication, that the company will not wholesale reject it and instead will work with you to make modifications and changes. Clearly something different happened here that should be of concern to people considering working at Google Brain.
Does the same paper get 1000+ citations if it were published in 2010? Or even 2015? Probably not.
Also, anyone who works in the field of AI fairness and ethics research knows about it. So yeah, it's an important study.
As far as I can see, the only way she would keep her job, is if her research was so fundamental to the company that they literally could not function without her. Citations don’t tell you that. My boss is a star researcher in his field with multiple 1000+ citation papers. He still has to act respectfully of his boss and peers.
What does that tell you?
Vs
FAANG hires top diverse ethics researchers for good publicity and they demand clout/unreasonable changes that aren't in FAANG's interest and they get kicked resulting in bad publicity.
Unclear which is happening here. I agree it isn't in FAANG interest to hire these people but that misses the point.
Industry research is not academia, where you'd expect to be free to choose the avenues of your research, and you should expect that publication is restricted. The technical improvements you make may be kept under wraps to gain a competitive advantage; and policy agenda work is essentally part of PR strategy, it's accepted if and only if that agenda benefits the strategic interests of the company. Tenure in academia offers some freedom of research (though not even then abolute), but when working for private companies, you don't have that freedom unless you have a specific contract asserting that, and even then you'd be wary of biting the hand that feeds you.
Like, if you want to expose climate change risks, it's not going to work out while employed in an oil company, and if you want to advocate for regulation of ML research while working in a company that would be bound by this regulation, this is certainly something that the management would be expected to care about.
I'm not sure Google Brain's recruiting pitch includes a description of them blocking publication of a paper you'd worked a long time on (and even given them a heads up about, as Gebru apparently had). Their pitch is almost certainly about being able to do research similar to how you would in academia (except with more money and resources, etc.).
Maybe if you’re going to hire ethics researchers, you should listen to them?
Doing work that needs to be actively suppressed is not producing value - at least not to the company. So apparently there's a fundamental misalignment between the work Dr. Gebru wants to do and the work that Google wants her to do; this was made clear with the suppression of the paper, and escalated as Dr. Gebru apparently (and understandably) did not want to work in a very different direction, (quoting her tweet) "asked for simple conditions first" which were totally unacceptable to the employer ("We cannot agree to #1 and #2 as you are requesting."), so that's it, if neither is willing to compromise on their primary goals, they can't work together.
This does indicate that apparently listening to ethics researchers they hired is unacceptable to Google. Sad, but not surprising.
I don't know about publishing standards at Google but, assuming they are uniform for all researchers, I am pretty sure Google would be unable to retain talent if researchers were asked to prove value to Google for every paper they publish. I think for researchers, this reinforces the oft-dismissed notion that you give up significant academic freedom in exchange for a fat paycheck when you join an industrial research lab.
This can be particularly damaging for Google because many of its research projects don't have an immediate business impact, and it hires top researchers by offering an alternative to the slog of academia.
Context:
> Timnit co-authored a paper with four fellow Googlers as well as some external collaborators that needed to go through our review process (as is the case with all externally submitted papers). We’ve approved dozens of papers that Timnit and/or the other Googlers have authored and then published, but as you know, papers often require changes during the internal review process (or are even deemed unsuitable for submission).
And the key point:
> Unfortunately, this particular paper was only shared with a day’s notice before its deadline — we require two weeks for this sort of review — and then instead of awaiting reviewer feedback, it was approved for submission and submitted.
Not sure who approved for submission. Gebru herself or by someone in management? Then they address the weaknesses of the paper (as part of the review process).
> A cross functional team then reviewed the paper as part of our regular process and the authors were informed that it didn’t meet our bar for publication and were given feedback about why. It ignored too much relevant research — for example, it talked about the environmental impact of large models, but disregarded subsequent research showing much greater efficiencies. Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues. We acknowledge that the authors were extremely disappointed with the decision that Megan and I ultimately made, especially as they’d already submitted the paper.
Granted, its hard to track the timelines and who said what at what time, but there seems to be reasons why the paper would of failed their internal review process.
Just to be clear, their end of the deal is to justify Google's actions as ethical, not to ensure that Google's actions are ethical.
"As far as I can tell" is doing a lot of work here.
I can confirm this is untrue. I worked with someone like Gebru (definitely an activist researcher) at a non-FAANG and AI ethics drove 3 multimillion dollar deals. Was a better business case than most I built over that time.
Besides, saying they don't drive revenue is a critique of research roles, not Gebru...
Also, let's be real. How much revenue are the vast majority of AI/ML researchers actually driving in these companies? Sure, someone gets promoted for multiple NeurIPS papers, and it looks great for the company. But most of the time, it doesn't directly impact products and revenue -- in the short-term -- and that's ok. Same deal for AI ethics and policy researchers.
Companies hire activists because they want to look good without actually changing things. Activists go to work for companies because they want to change things. So, naturally, the company has to lie to the activist about their function to do this, and the activist has to be naive about it. If the activist starts doing what they want to do, and not what the company wants them to do, then the company will fire them, and the activist will reach for an explanation.
I agree with this statement but for the life of me I can’t come up with a satisfactory answer as to why companies don’t want to actually change things. Is it purely institutional inertia? Are the benefits of a more diverse workplace not accepted by the powers that be, so efforts to achieve that are undermined?
If Timnit Gebru were a cynical opportunist, she would just hop on the bandwagon, pretend to care and collect her paycheck. But she seems to be a true believer, and true believers won't accept ineffectual groveling. They want to see the real thing. Ergo, collision.
The company doesn't "want" anything. It's a big social machine that is not so much designed as evolved, and only the very core of the company experiences selection pressure.
At the center of every company is a system that prints money. This bit is almost all that really matters, and is the part that experiences selection pressure.
Threaten it, screw with it, or break it and you will be out of a job, because you either killed the company or got thrown out by people who were afraid you would (or, sometimes, who are just greedy and were worried you'd hurt the amount of money they make through the company).
Everything outside of that central system is secondary, and doesn't really impact the company's survival a hoot.
People at the company may love their secondary systems, really believe they matter, and pour sincere effort and careers into them, but when secondary systems come into conflict with primary systems, they Lose. Every. Time.
In the very long term, nothing else can happen, at least in for-profit companies. Competition will destroy kinder companies by being ruthless to secondary systems that the kinder ones keep. This is what Scott Alexander of Slate Star Codex calls the "Malthusian race to the bottom". Amazon and Wal-Mart are locked in a violent struggle of this nature right now.
I think most people are not entirely aware of these dynamics, as my premise that companies are mostly evolved not designed suggests.
So, in all likelihood, there are very sincere people who really want to see the company change for the better recruiting activists and noble researchers.
Everyone likes to feel that they're being goodness, so they all applaud the secondary "goodness optimization" systems.
After enough time, though, those activists come into conflict with a primary system, and discover to their shock that they don't have the leverage to change it at all. This is particularly astonishing to them because they've fought to change a lot of secondary systems and had many successes there.
They (rightly, from their frame of reference) refuse to budge, get fired or leave, wash their hands of the place, then start at the next place in one of its secondary systems.
Rinse and repeat.
It's hard being human.
"Look how awesome this activist is we're hiring," easily becomes "Look how unreasonable this employee is we're firing."
In this case, both Google (a social justice activist gets them into a public screaming match, what a surprise) and Ms. Gebru (played chicken with her employer and lost).
Even more than that, it's far easier in infosec to say "There is gatekeeping going on. I'm going off to make my own space where you're not invited."
It has become an archetype at this point.
But that said I can see some similarities with the whole politics at work landmine issue.
Judging by your interpretation of James memo I'm leaning towards that direction. Especially considering the fact James made multiple direct claims in the memo he was not suggesting anything of the sort which you are alleging (I have a feeling few people actually read the memo).
Regardless the two stories were very very different. Nor does his story match my comment's 'archetype' of a certain type of employee who always end up flaming out of their job, usually via making non-conditional demands (unsurprisingly coming from a bubble/worldview where it's entirely normal to have things which are not open to discussion).
Seems to be a very broad brush that you're painting with. "Progressive people" encompasses a wide variety of individuals and beliefs.
> I think this is all a good thing because it may alert some executives to the price for hiring activists into research roles.
Ah, yes. They're going to do their jobs and point out poor ethics and policy in _your_ company. I mean, they were hired for that, but if they could just look down and _pretend_ to care about the space they were hired for, instead of actually caring, that'd be great.
> You are not worth having any conversations about this, since you are not someone whose humanity (let alone expertise recognized by journalists, governments, scientists, civic organizations such as the electronic frontiers foundation etc) is acknowledged or valued in this company.
It feels more generally accurate to say that no ones humanity is respected at companies like Google. That isn't to discount or lessen the difficulties minorities and women have in tech companies; those are substantial and significant. But if someone in a diversity role is slighted, the natural place to jump is a diversity motive; its far more likely that the company just doesn't give a shit about anyone.
And that's true of nearly every company. It was immature for us, as a community, to believe big tech would be any different than any other megacorp. They say they care about diversity, inclusion, and people; they don't. They don't care about any individual. Companies, as a collective intelligence, care about two things: Money and Self-Preservation (in that order).
That being said, I totally support the fight that people like Timnit are fighting; they're fighting for the recognition of humanity, through the lens of diversity and inclusion, a critical component of a much larger fight intrinsic to a capitalistic society. That's the value of a hire like this; its just the unimaginably unfortunate case that this value hasn't been realized at Google, and probably never will.
From what I can tell, she doesn't seem to address the points raised at all and instead complains they won't tell her exactly who said what.
https://www.nature.com/articles/nn0399_197
I think the process being opaque is more detrimental, because there's no way for anyone outside of the process to know it happens. If it wasn't opaque, then everyone could see when it happens.
Not being able to engage in a debate about the merits of something is also sketchy. It seems like an order being dressed-up as peer feedback.
IMO it’s the _companies_ that strike me as toxic drama queens with their shady tactics and obfuscations, hiring ethics and policy folks to look good without any intent on following through with support or respect.
The idea that companies only need to do maximize shareholder value isn't that old and was only popularized in the 80s. If you restrict creating value to that, then maybe she didn't create any at Google. But maybe Google wants to create a software that works equally well for everyone and raising the issue of IA biases would have helped achieve that goal.
How is this either/or? Highly educated people can still join fringe political clubs.
There is nothing about technical education that immunizes you against radical politics. At the risk of Godwinizing the reply: the engineers who built the first liquid fuelled rockets in Peenemunde were N..z..s, including the guy who was later brought into the US and built all kind of powerful and ingenious rockets there (Wernher von Braun).
- Timnit submits a paper to a conference about environmental costs of large language models like BERT. Note Google invested massively in BERT for their infrastructure this year.
- Right before the external deadline, she submits it for internal review
- Internal review asks for revisions, they want mitigations they worked on mentionned at minimum in the paper.
- She responds to these with an effective "publish or I QUIT" email
- However you put it, she gets terminated.
- Gebru is somehow shocked at this and posts her half on social media
Seeing this develop over the last day, I've grown less empathetic to her side of this affair. She created an unwinnable situation, then responded with an ultimatum.
She is fired because she works against the interests of the company who hired her.
The outcome won't be different if you are a man.
What is the story?
Sadly, she will undoubtedly come up with some trumped up reason to sue for discrimination and probably be bought off with a settlement.
In that thread Timnit established that she was an "authority" and then instead of engaging on the merits in the conversation, simply said basically, "You have to submit to me because I'm the authority" and refused to offer any information of any substance ... as though she was some kind of wizard and what she knew was just way too complicated for us mortals to understand.
Meanwhile, LeCun just very calmly engaged on the specific technical details about bias in Deeplearning systems.
After that, Twitter just piled on LeCun and claimed he was being a "mansplainer" ... as though saying anything technical to a black woman is "mansplaining".
As an engineer what would you seek to research if you wanted to reduce the bias in specific AI systems? You'd figure out how to minimize bias in the algorithms and in the data, and identify any other sources that could introduce bias, and figure out how to put controls on developers and data collectors to prevent bias ... right?
Ok, now go look at what is actually discussed in AI bias papers.
Sometimes I feel the emperor has no clothes and everyone just pretends like vacuous bullshit is something profound because if you criticize the papers you'll be fired or blacklisted in Silicon Valley.
> This is the exact email I received from Megan who reports to Jeff > Who I can't imagine would do this without consulting and clearing with him of course
"This is the exact email I received from Megan who reports to Jeff. Who I can't imagine would do this without consulting and clearing with him of course."
I am sure Jeff Dean was made aware of the situation given the PR impact. But it is a stretch to say that Jeff Dean personally decided to fire her against her manager's wishes.
Allegations like that need evidence.
These dismissal decisions are not made lightly and I would wager there was a long history of events leading up to this. You usually only see the straw that broke the camel's back.
Then you try to engage in a conversation about how this is not acceptable and people start doing the opposite of any sort of self reflection—trying to find scapegoats to blame.
The message was clear, stop! The paper rubbed someone the wrong way. Go rewrite it on your own without any references to Google and publish it. I've been in tech for a long time. In nearly every org turnover was minimal on the engineering side of the house versus sales who dropped like flies every quarter. The only people who were ever laid off were those who routinely rocked the boat. Getting some sense of that here.The current HN story is titled "AI researcher Timnit Gebru resigns from Google". That current title is either inaccurate or is pure editorial from the submitter.
By the way, that part about unions and strikes also applies to the joined at the hip government as well.
None of these comments offer any substance on the main issue in focus: the fact that Google may be actively suppressing the publication of valuable research for reasons other than its academic merit.
Of course there are all kinds of ethical questions that can arise in that situation, but is that not the normal case in corporate research?
> Jeff Dean, Google’s head of AI, defended the decision in an internal email to staff on Thursday, saying the paper “didn’t meet our bar for publication”. He also described Ms Gebru’s departure as a resignation, after Google had refused to agree to unspecified conditions she had set to stay at the company.
> The dispute has threatened to shine a light on Google’s handling of internal AI research that could hurt its business, as well as the company’s long-running difficulties in trying to bring more diversity to its workforce. ...
> The paper looked at the potential bias in large-scale language models, one of the hottest new fields of natural language research. Systems like OpenAI’s GPT-3 and Google’s own system, Bert, attempt to predict the next word in any phrase or sentence — a method that has been used to produce surprisingly effective automated writing, and which Google uses to better understand complex search queries.
> The language models are trained on vast amounts of text, usually drawn from the internet, leading to warnings that they could regurgitate racial and other biases that are contained in the underlying training material.
> “From the outside, it looks like someone at Google decided this was harmful to their interests,” said Emily Bender, a professor of computational linguistics at the University of Washington, who co-authored the paper.
[1] https://www.ft.com/content/995c62ab-26b1-4eed-b1fb-cb4846023...
So I don't work in AI, but in every field I have worked in, and in the academic journals I used to work for, all of these are issues that would be addressed during the standard peer review process.
You ignored recent publications? Reviewers will complain. A good journal will have peer reviewers who know which citations are missing.
You left out citations that weaken your conclusion? Reviewers will complain. Et cetera.
I realize people object to Gebru's history on Twitter, but Google exec's defense of her dismissal sounds pretty weak to me.
Some of the worst people in history who committed the worst atrocities were very passionate about making the world a better place, at least as they defined “better”.
Much more interesting questions that might get revealed a bit:
Does Google treat minorities appropriately? Is Google covering up ai ethics research? Does Google care about AI ethics/bias?
From what I've seen, I agree with Gebru about AI research, but this letter has too many problems itself.
The only reason that department exists is because it was regulated into existence.
So, no, Google does not particularly care about AI ethics. They care about not getting harangued by the US government.
Google cares about AI ethnics because talking about it gives those people, especially higher ups, an imagined sense of significance and adrenaline rush of being a savior.
But in reality, AI ethnics is just a gloried showroom of diversity/inclusiveness.
It is not a product, it doesn't generate revenue, in corporate world, nobody cares.
A plague on both your houses!
And Hello, Streisand effect!
I think this title could be a little more descriptive. The conversation is about DEI, the fact she pointed out more accountability is necessary, the abruptness of it all, etc. I didn't know who Timnit Gebru was and almost didn't click on it because this sounded like some random researcher and I'm sure Google fires people all the time.
Once I was reading it I realized this is quite interesting after all.
I don't care if the corporations building a dystopian panopticon are intersectional.
Similarly, it raised concerns about bias in language models, but didn’t take into account recent research to mitigate these issues.
When Jeff Dean wrote me feedback for a small thing that I made, I was extremely happy to even get an answer from him. I think Timnit doesn't have any idea of the things Jeff and Sanjay wrote together, their code base was always clean, beautiful and well documented and tested, with lots of benchmark tests. She should have gone with the comments and work much more on the paper.
Timnit definitely did not intend to resign "immediately" and from everything what is known was fired on the spot (that she mentioned a possible resignation in an Email is not important for that distinction). A correct headline would be "AI researcher Timnit Gebru fired by Google after threatening to resign".
Neither "fired" nor "resigns" seems correct. I feel that she was "forced out" or "let go" (ironically this euphemism is more accurate here). She threatened to leave and they kicked her out.
That's all I need to know about why she was fired. I'm glad Google despite all the stuff they've done before knows when someone has gone off the SJW deep end.
This is a silly communion that puts both sides to shame.
Late stage capitalism is such a circus.
https://knowyourmeme.com/memes/events/donglegate-adria-richa...
This also sounds like an opportunity for an awesome person to spread their wings now they're out from under what sounds like a pretty oppressive system
Her biggest accomplishment seems to be driving Yann LeCunn off Twitter with angry accusations. She tried to continue her power trip at a workplace but her boss called her bluff.
This is a great firing for Google. She won’t be missed.
The first paper listed there has over 1000 citations in 2 years. That’s influence and impact.
Just because you don’t know of her work doesn’t mean that her work has not had an impact and that she’s not well known in her research community. She definitely is.
Everything you've said here is not only falsifiable, but straight up false.
It appears you didn't even try to challenge your own beliefs before spraying them out into the public sphere. You aren't representing yourself in a decent light.
If someone would link this to me, I'll interpret it as extremely dismissing. A declaration of war.
Umm, among the other issues with your post, Yann LeCunn last tweeted 12 hours ago...
https://twitter.com/ylecun/status/1334409408537825282
("she turned me into a Newt!")
Yikes.
Obviously, this is a person which is very passionate about her research. She’s also a Black woman; given US history, there’s a probability that she was discriminated against during her life — maybe, multiple times. If not her, maybe some of her relatives were. Sure, this is hypothetical and does not excuse her attitude — but try to put yourself in her shoes.
It’s easy for us to reason about it, and think about how we would have dealt with it differently. Maybe she was in a bad place, or felt that she was being discriminated against.
She’s also a human being like me and you so — yes — maybe it’s not about racism and discrimination. Maybe she’s just entitled.
Either way, Google’s HR should’ve done better. It’s easy to let anger or exasperation get the hang of you. They should’ve scheduled a call to discuss everything calmly.