HNHacker News
TopNewBestAskShowJobs

nybsjytm

514 karma · joined December 14, 2023

submissionscomments
nybsjytm··on Terence Tao on O1
Tao is famous for being the world's most singular and inspiring genius. It's kind of a meme position* that most people accept because they think everyone else accepts it, but for people of a certain inclination, it makes anything he might say into a Pronouncement to read depths into. If you think someone is possibly the greatest mathematician of all time, you'd be interested in everything they think!

(* I think one could very legitimately view him as the top researcher in harmonic analysis in the world - he is a great mathematician - but it's not clear to me how people go from that to Epochal Genius and his extreme celebrity status across STEM)

nybsjytm··on Terence Tao on O1
> If arguably the person with the highest IQ currently living, is impressed but still not fully satisfied that a computer doesn’t give Nobel prize winning mathematical reasoning

No offense, but every part of this characterization is really unserious! He says "the model proposed the same strategy that was already identified in the most recent work on the problem (and which I restated in the blog post), but did not offer any creative variants of that strategy." That's very different from what you're suggesting.

The way you're talking, it sounds like it'd be actually impossible for him to meaningfully say anything negative about AI. Presumably, if he was directly critical of it, it would only be because his standards as the world's smartest genius must simply be too high!

In reality, he's very optimistic about it in the future but doesn't find it useful now except for basic coding and bibliography formatting. It's fascinating to see how this very concrete and easily understood sentiment is routinely warped by the Tao-as-IQ-genius mythos.

nybsjytm··on Terence Tao on O1
> ‘Able to make the same creative mathematical leaps as Terence Tao’ seems like a pretty high bar to be setting for AI.

There's no need to try to infer this kind of high bar, because what he says is actually very specific and concrete: "Here the result was mildly disappointing ... Essentially the model proposed the same strategy that was already identified in the most recent work on the problem (and which I restated in the blog post), but did not offer any creative variants of that strategy." Crucially the blog post in question was part of his input to ChatGPT.

Otherwise, he's been clear that while he anticipates a future where it is more useful, at present he only uses AI/ChatGPT for bibliography formatting and for writing out simple "Hello World" style code. (He is, after all, a mathematician and not a coder.) I've seen various claims online that he's using ChatGPT all the time to help with his research and, beyond the coding usage, that just seems to not be true.

(However, it's fair to say that "able to help Terence Tao with research" is actually a high bar.)

nybsjytm··on Terence Tao on O1
The issue is that a hypothetical answer from a LLM is not even remotely easy to directly put into lean. You might ask the LLM to give you an answer together with a lean formalization, but the issue is that this kind of 'autoformalization' is at present not at at all reliable.
nybsjytm··on Terence Tao on O1
If Tao says he's interested in something being coded in lean, there are literal teams of people who will throw themselves at him. Those projects are very well organized from the top down by people who know what they're doing, it's no surprise that they are able to create some space for people who don't understand the whole scope.

This is also the case for other top-profile mathematicians like Peter Scholze. Good luck to someone who wants to put chatgpt answers to random hypotheticals into lean to see if they're right, I don't think they'll have so easy a time of it.

nybsjytm··on Terence Tao on O1
To code proofs in lean, you have to understand the proof very well. It doesn't seem to be very reasonable for someone learning material for the first time.
nybsjytm··on Terence Tao on O1
Daniel Litt, an algebraic geometer on twitter, said "Pretty impressed by o1-preview! Still not having much luck asking it to do any interesting math but it seems much more reliable with simple things; I can actually imagine it being a net time-saver at this point with some non-mathematical tasks."

Any other takes by mathematicians out there?

nybsjytm··on Terence Tao on O1
Good luck! That can be pretty hard to do when you're at the learning stage, and I would think doubly so given the LLM style where everything 'looks' very convincing.
nybsjytm··on LLMs Will Always Hallucinate, and We Need to Live with This
Does it matter that, like so much in the Math for AI sphere, core details seem to be totally bungled? e.g. see various comments in this thread https://x.com/waltonstevenj/status/1834327595862950207
nybsjytm··on Terence Tao on O1
How will you know if its answers are correct or not?
nybsjytm··on AI solves International Math Olympiad problems at silver medal level
No, I don't mean that the search space is small. I just mean that there are special techniques which are highly relevant for IMO-type problems. It'd be interesting to know how important that knowledge was for the design and training of AlphaProof.

In other words, how does AlphaProof fare on mathematical problems which aren't in the IMO style? (As such exceptions comprise most mathematical problems)

nybsjytm··on AI solves International Math Olympiad problems at silver medal level
To what extent is the training and structure of AlphaProof tailored specifically to IMO-type problems, which typically have short solutions using combinations of a small handful of specific techniques?

(It's not my main point, but it's always worth remembering - even aside from any AI context - that many top mathematicians can't do IMO-type problems, and many top IMO medalists turn out to be unable to solve actual problems in research mathematics. IMO problems are generally regarded as somewhat niche.)

nybsjytm··on I am starting an AI+Education company
Ok. Thanks for the contribution.
nybsjytm··on I am starting an AI+Education company
Thank you for this AI slop. It's the right answer but incoherent reasoning. It could have equally reasonably said:

"The one that doesn't fit in is Socrates.

Richard Feynman and Bill Gates are primarily known for their contributions to science and philanthropy, respectively. Feynman was a renowned theoretical physicist, and Gates is a world-famous philanthropist.

Socrates, on the other hand, is primarily known for foundational contributions to philosophy. His primary domain is thus distinct from the scientific and philanthropic realms of Feynman and Gates."

nybsjytm··on I am starting an AI+Education company
> I would venture most industries, with foundations on other research fields, are likely the same.

"Industries" is a key word though. Academic research, though hardly without its own major problems, doesn't have the same set of corrupting incentives. Although the lines are blurred, one kind of research shouldn't be confused with another. I do think it's exactly right to think of AI researchers the same way we think of R&D people in oil & gas, not the same way we think of algebraic topologists.

nybsjytm··on I am starting an AI+Education company
I think you've misread this conversation. I was responding to someone who suggested that Karpathy's "background in physics" indicated some insight into whether this venture, particularly as regards physics education, will effectively give guidance by subject matter experts like Feynman.

If they had cited some other background, like his courses on AI, I would have responded differently.

nybsjytm··on I am starting an AI+Education company
It's legitimate to call it a background in physics, but given the particular level of background and the context of this particular issue, its relevance is indistinguishable from zero.

Has he ever demonstrated any particular insight or understanding of physics or - more importantly - of physics education? As far as I've been able to find, the answer is no. Not that there's anything wrong with that. At worst it just makes him a typical physics major.

nybsjytm··on I am starting an AI+Education company
As far as I can see there are pretty much zero incentives in the AI research arena for being careful or intellectually rigorous, or being at all cautious in proclaiming success (or imminent success), with industry incentives having well invaded elite academia (Stanford, Berkeley, MIT, etc) as well. And culturally speaking, the top researchers seem to uniformly overestimate, by orders of magnitude, their own intelligence or perceptiveness. Looking in from the outside, it's a very curious field.
nybsjytm··on I am starting an AI+Education company
> Feynman, Bill Gates, Socrates, etc.

One of these doesn't quite belong ;)

But these AI researchers don't even understand these figures except as advertising reference points. The Socratic dialogue in the "sparks of AGI" paper https://arxiv.org/abs/2303.12712 has nothing whatsoever to do with Socrates or the way he argued.

Fourteen authors and not a single one seemed to realize there's any possible difference between a Socratic dialogue and a standard hack conversation where one person is named "Socrates."

nybsjytm··on I am starting an AI+Education company
My point is that he's a world expert on the engineering of AI systems. That shouldn't be mistaken for expertise, or even general knowledge, about anything else.

It's a good principle to bear in mind for people from any profession, but top AI engineers in particular seem to have an unusually significant habit of not being able to recognize where their expertise ends and expertise from another field (such as, say, education) begins. They also seem very prone to unfounded hype - which isn't to say they're not also good researchers.

Maybe Karpathy happens to be better on this than his peers, I wouldn't know.

nybsjytm··on I am starting an AI+Education company
> As Andrej has a background in physics

This seems rather generous given that he was just a physics major. There's lots of physics majors who understand very little about physics and, crucially, nothing about physics education.

nybsjytm··on I am starting an AI+Education company
> ... in the case of physics one could imagine working through very high quality course materials together with Feynman ... with recent progress in generative AI, this learning experience feels tractable.

Actually, this seems to be absurdly beyond any of the recent progress in generative AI. This sounds like the kind of thing people say when their only deep knowledge is in the field of AI engineering.

nybsjytm··on A.I. Has Become a Technology of Faith
I can also make a prediction for every single known protein, it's trivial to do. My own predictions would be uniformly wrong. The question is how accurate AlphaFold's predictions are - of course, this question was almost totally avoided by the news reports and DeepMind press releases. It is accurate enough (and accurate often enough) to be a useful tool but by no means accurate enough to say they "literally solved protein folding."
nybsjytm··on A.I. Has Become a Technology of Faith
I wouldn't worry, I think what you're saying is pretty well known. We've all heard it before from every tech evangelist out there. Everyone knows that sometimes tech naysayers turn out to be wrong; the point is that it's pretty useless information.
nybsjytm··on A.I. Has Become a Technology of Faith
> I think this movement around 'debunking AI' is entirely the fault of marketing and company CEOs inflating the potential around generative AI to such ridiculous amounts.

I don't think you should let the AI research community off the hook so easily. Some of the most obnoxious and influential voices are researchers who are taken as credible authorities. I'm thinking for instance of the disgraceful "Sparks of AGI" paper from Sebastien Bubeck's research team at Microsoft Research, also certain "godfathers", etc.

nybsjytm··on A.I. Has Become a Technology of Faith
> If someone's AI tech does end up "changing the future" then how would you not be incorrect if you had previously said it was vaporware?

"This product is vaporware" doesn't mean "This product is impossible and can never come to fruition." Vaporware is "software or hardware that has been advertised but is not yet available to buy, either because it is only a concept or because it is still being written or designed."

It doesn't matter even slightly if Altman and Huffington's app will materialize and change the universe; it's still vaporware. It's just what the word means.

nybsjytm··on A.I. Has Become a Technology of Faith
> They literally solved protein folding with AI

AlphaFold deserves some hype but this is a tremendous overstatement.

nybsjytm··on A.I. Has Become a Technology of Faith
Right now, as stated, the "Yang" side as applied to AI is clearly true. Even if the tech will "change the future" it will be no less correct for us to say that current AI products are overhyped/vaporware and that AI salesmen and researchers are passing off sci-fi stories and business strategies as wise prognostication. Even if what they're saying turns out to be true, it's completely correct to say that they're just (sometimes unbeknownst to themselves) wildly guessing.
nybsjytm··on A.I. Has Become a Technology of Faith
Just for balance, here's 84 examples of the opposite: https://www.theverge.com/2019/12/20/21029499/decade-fails-fl...
nybsjytm··on A.I. Has Become a Technology of Faith
> to me this feels applicable to a lot of things that have gone on to be revolutionary.

The big issue is that it's also applicable to a lot of other things.

← PreviousPage 2 of 4Next →