(* I think one could very legitimately view him as the top researcher in harmonic analysis in the world - he is a great mathematician - but it's not clear to me how people go from that to Epochal Genius and his extreme celebrity status across STEM)
514 karma · joined December 14, 2023
(* I think one could very legitimately view him as the top researcher in harmonic analysis in the world - he is a great mathematician - but it's not clear to me how people go from that to Epochal Genius and his extreme celebrity status across STEM)
No offense, but every part of this characterization is really unserious! He says "the model proposed the same strategy that was already identified in the most recent work on the problem (and which I restated in the blog post), but did not offer any creative variants of that strategy." That's very different from what you're suggesting.
The way you're talking, it sounds like it'd be actually impossible for him to meaningfully say anything negative about AI. Presumably, if he was directly critical of it, it would only be because his standards as the world's smartest genius must simply be too high!
In reality, he's very optimistic about it in the future but doesn't find it useful now except for basic coding and bibliography formatting. It's fascinating to see how this very concrete and easily understood sentiment is routinely warped by the Tao-as-IQ-genius mythos.
There's no need to try to infer this kind of high bar, because what he says is actually very specific and concrete: "Here the result was mildly disappointing ... Essentially the model proposed the same strategy that was already identified in the most recent work on the problem (and which I restated in the blog post), but did not offer any creative variants of that strategy." Crucially the blog post in question was part of his input to ChatGPT.
Otherwise, he's been clear that while he anticipates a future where it is more useful, at present he only uses AI/ChatGPT for bibliography formatting and for writing out simple "Hello World" style code. (He is, after all, a mathematician and not a coder.) I've seen various claims online that he's using ChatGPT all the time to help with his research and, beyond the coding usage, that just seems to not be true.
(However, it's fair to say that "able to help Terence Tao with research" is actually a high bar.)
This is also the case for other top-profile mathematicians like Peter Scholze. Good luck to someone who wants to put chatgpt answers to random hypotheticals into lean to see if they're right, I don't think they'll have so easy a time of it.
Any other takes by mathematicians out there?
In other words, how does AlphaProof fare on mathematical problems which aren't in the IMO style? (As such exceptions comprise most mathematical problems)
(It's not my main point, but it's always worth remembering - even aside from any AI context - that many top mathematicians can't do IMO-type problems, and many top IMO medalists turn out to be unable to solve actual problems in research mathematics. IMO problems are generally regarded as somewhat niche.)
"The one that doesn't fit in is Socrates.
Richard Feynman and Bill Gates are primarily known for their contributions to science and philanthropy, respectively. Feynman was a renowned theoretical physicist, and Gates is a world-famous philanthropist.
Socrates, on the other hand, is primarily known for foundational contributions to philosophy. His primary domain is thus distinct from the scientific and philanthropic realms of Feynman and Gates."
"Industries" is a key word though. Academic research, though hardly without its own major problems, doesn't have the same set of corrupting incentives. Although the lines are blurred, one kind of research shouldn't be confused with another. I do think it's exactly right to think of AI researchers the same way we think of R&D people in oil & gas, not the same way we think of algebraic topologists.
If they had cited some other background, like his courses on AI, I would have responded differently.
Has he ever demonstrated any particular insight or understanding of physics or - more importantly - of physics education? As far as I've been able to find, the answer is no. Not that there's anything wrong with that. At worst it just makes him a typical physics major.
One of these doesn't quite belong ;)
But these AI researchers don't even understand these figures except as advertising reference points. The Socratic dialogue in the "sparks of AGI" paper https://arxiv.org/abs/2303.12712 has nothing whatsoever to do with Socrates or the way he argued.
Fourteen authors and not a single one seemed to realize there's any possible difference between a Socratic dialogue and a standard hack conversation where one person is named "Socrates."
It's a good principle to bear in mind for people from any profession, but top AI engineers in particular seem to have an unusually significant habit of not being able to recognize where their expertise ends and expertise from another field (such as, say, education) begins. They also seem very prone to unfounded hype - which isn't to say they're not also good researchers.
Maybe Karpathy happens to be better on this than his peers, I wouldn't know.
This seems rather generous given that he was just a physics major. There's lots of physics majors who understand very little about physics and, crucially, nothing about physics education.
Actually, this seems to be absurdly beyond any of the recent progress in generative AI. This sounds like the kind of thing people say when their only deep knowledge is in the field of AI engineering.
I don't think you should let the AI research community off the hook so easily. Some of the most obnoxious and influential voices are researchers who are taken as credible authorities. I'm thinking for instance of the disgraceful "Sparks of AGI" paper from Sebastien Bubeck's research team at Microsoft Research, also certain "godfathers", etc.
"This product is vaporware" doesn't mean "This product is impossible and can never come to fruition." Vaporware is "software or hardware that has been advertised but is not yet available to buy, either because it is only a concept or because it is still being written or designed."
It doesn't matter even slightly if Altman and Huffington's app will materialize and change the universe; it's still vaporware. It's just what the word means.
AlphaFold deserves some hype but this is a tremendous overstatement.
The big issue is that it's also applicable to a lot of other things.