HNHacker News
TopNewBestAskShowJobs

HarHarVeryFunny

8,345 karma · joined July 29, 2017

submissionscomments
HarHarVeryFunny··on More questions about whether researchers can trust OpenAI with unpublished math
> What sort of guidance do you think is happening in a 10k agent, 320b token, 88 hour run ? AI did this one

If you read the PDF release by Buckmaster, apparently the initial claim from Brubeck was that there as very little human input involved, then as the call progressed more and more people popped up that has been involved with it.

Does this aspect really matter? Not really, other than OpenAI wanting to present this as all the work of their model.

**

https://cims.nyu.edu/~tristanb/statement.pdf

I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used.

I asked when the first prompt had been sent by them. This question was not answered directly by OpenAI for some time. Eventually it was agreed that it had been sent in the past few days, after information about our work had reached OpenAI.

HarHarVeryFunny··on More questions about whether researchers can trust OpenAI with unpublished math
OK, good to know (if they can be trusted - Altman clearly is a liar), but it doesn't really change the big picture much.

1) OpenAI by their own admission, only re-tackled Navier-Stokes because they heard it had already been solved (but not yet published). This isn't advancing science or helping the mathematical community, this is just being a dick.

2) OpenAI, specifically Sebastien Brubeck, then threaten to "not be nice" and "ruin the career" of one of the mathematicians whose work they had succeeded in duplicating, unless he agreed (which he refused to do) that his collaborator, an Anthropic employee, was not named. This is not only against mathematical norms of credit assignment, it is also being a pathetic human being.

OpenAI would have you believe this result shows how powerful their mystery better-than-Astra model is, but the reality here is that this model needed 10,000 agents, $20M of compute, and the assistance of a whole team of people at OpenAI, to replicate (then exceed) the work that just took two people, with some academic grants as an AI spending budget to achieve (a few $100K - listed below).

https://cims.nyu.edu/~tristanb/

I'd say advantage humans this time. Better luck next time OpenAI - and if you don't want unfavorable comparisons then maybe choose to work on problems that have not been solved yet, and that humans are NOT making nice progress on.

HarHarVeryFunny··on Douglas Hofstadter: Analogy as the Core of Cognition [video]
It's been a long time since I read Hofstader's book "Fluid Concepts and Creative Analogies" that this is presumably based on, so I'll be interested to watch the video as a refresher, later. :) He also wrote a follow-on book, "Surfaces and Essences: Analogy as the Fuel and Fire of Thinking", published after this video was made, that I've never read.

From what I recall, to Hofstafer analogy making isn't some higher level cognitive process, certainly not a language based one, but basically is THE cognitive process all the way from perception on up, and is the mechanism by which we form object categories in the first place.

As always Hofstader's ideas are interesting, but I can't say I agree with them. It seems that the key evolutionary benefit, and function, of a brain is prediction, which is the superpower that moves us from being stuck in the present to being able to "see" (predict) the future, and therefore from being merely reactive to being able to proactively plan and predict future outcomes (what will the sabre-tooth do, where is the water supply?) based on our experience.

Given the never-same-twice nature of sensory perception, before you can predict you need to be able to generalize/categorize, which I think Hofstader would regarded as analogy making (how is this thing I'm seeing similar to what I've previously seen?), although it seems the actual mechanism involved is embeddings or embedding-like representations where similar inputs have similar representations, and what might more simply be considered as associative recall provides the generalization from view/instance to identity/category.

So, is it really analogies all the way up, or are our perception and cognitive processes better regarded as generalization and prediction, which seem not only seem to have direct and obvious neural realizations, but also match the evolutionary needs that we would expect to exist?

HarHarVeryFunny··on Douglas Hofstadter: Analogy as the Core of Cognition [video]
Hoftstader's video is pressumably based on his own book "Fluid Concepts and Creative Analogies".
HarHarVeryFunny··on More questions about whether researchers can trust OpenAI with unpublished math
OpenAI said they sicced this agent army on Navier-Stokes on Sept 1st, while only a couple of days earlier OpenAI's Noam Brown happened to reply to a tweet saying that they had already tried to solve all the Millennium Prize problems and failed... So, it seems either the previous attempt didn't have the training to succeed, or was just not given the compute to do so.

Once OpenAI heard that Navier-Stokes was solved, this caused them to immediately revisit the problem and throw a ton of compute at it, apparently using a more (very) recent model than what they had tried before. What we don't know is just how recent this model was, and therefore what it may have been trained on. Buckmaster/Levant had apparently been working towards this for at least a year, and made their "forced" blow-up breakthrough on August 15th.

Presumably any anonymized prompts that are being trained on are part of pre-training, so older, but once OpenAI had heard that Navier-Stokes had been solved and wanted to revisit it, it seems possible they may have done a few weeks of incremental RL training on anything Navier-Stokes adjacent they could come up with, in addition to then throwing unlimited compute at it, now confident that there was something to find.

HarHarVeryFunny··on More questions about whether researchers can trust OpenAI with unpublished math
It seems that in this case OpenAI are suggesting that the researchers whose work they scooped were using OpenAI models with an account setting that allowed OpenAI to train on anonymized prompts.

It seems that Buckmaster and Levant (who is an Anthropic employee) were rather naive in the amount of trust they had in OpenAI, with Buckmaster going so far as to contact OpenAI's Sébastien Bubeck to discuss what they were working on and clarify that contrary to rumor this was a private collab.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
I'm not joking. Compare to a super-human MCTS system like AlphaGo or Stockfish - once you condense the expertise of your top 10K world experts into a board evaluation or policy function, then the rest is brute force.

Whether this type of agentic swarm approach can be considered closer to MCTS (search), or closer to a less structured GOFAI blackboard type approach (perhaps more like your mathematician retreat) I'm not sure - I don't think they've released any details of the prompt(s) and how these agents were collaborating and building on each others work.

The other part of my easter egg analogy is the direction to "look over there", corresponding to OpenAI specifically asking their hoard of mathematicians to work on Navier-Stokes since they knew it was solvable/determinable, and they certainly had the public work that Buckmaster/Levant were building on as further direction, as well as perhaps their prompts. Unlike Buckmaster/Levant, this wasn't just a couple of humans with a university research grant budget, this was apparently a not-so-small team at OpenAI (says Buckmaster, per a group call he had with OpenAI), with an unlimited budget, so it's hardly surprising (or in the least bit impressive) that they were able to duplicate and surpass their work.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
Is it really important for engineers, etc?

In reality you can't have things like infinite velocity, so if Navier-Stokes is predicting blowups, then isn't this a problem with Navier-Stokes not handling some edge cases, not a problem with reality that engineers need to be concerned about?

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
> OAI pushed a button and solved NS

Not exactly...

From here:

https://cims.nyu.edu/~tristanb/statement.pdf

"I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem".

HarHarVeryFunny··on How An AI math breakthrough ignited a controversy
OpenAI know the exact timelines involved, and what they train on, or do not.

You're right - it is exactly "lawyer speak", rather like Bill Clinton's "I did not have sex with that woman".

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
> What claim would that be ?

Huh? I'm saying there isn't one.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
With 10,000 agents and $20M of compute this is just brute force search.

It's a bit like telling 10,000 kids there's an easter egg hidden over there, pointing to one corner of your yard (or having "heard a rumor" it was hidden in that corner).

If you have $20M to spend on your problem, then yes, AI brute force search is an option, but unless you know a solution is possible (as OpenAI did here), you may still be wasting your money.

HarHarVeryFunny··on How An AI math breakthrough ignited a controversy
They might, or they might just get out-spent and scooped by OpenAI.

This isn't the way you build trust.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
You don't need to speculate here, since much of the story is not being disputed.

The recent ground-breaking work on Navier-Stokes "blow-ups" was done over a period of years by mathemtaticians Diego C´ordoba and Luis Martınez-Zoroa.

NYU professor Tristan Buckmaster and Anthropic employee (& mathematician) Levent Alpoge took the above work as a starting point, and over a year with LLM assistance developed a blow-up proof under certain conditions.

Buckmaster: "We used several LLMs throughout: Anthropic’s Claude, OpenAI’s Codex, especially with GPT-5.6 Sol and, more recently, Astra. The latter was only used for writeups and auditing our arguments."

Buckmaster says he thinks that Martınez-Zoroa, whose work this all builds on, deserves the Fields Medal for his work.

OpenAI claim that on Sept 1st they heard a rumor the problem has been solved (which happened on August 15th), and then decided to re-solve it themselves using a 2-week old model, then later reached out to Prof. Buckmaster and Levant to come to some agreement to co-publish.

OpenAI: "While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models ". In other words, not only did they deliberately choose to tackle a problem they heard had already been solved (in turns out only partially solved), but they may have done so using a model that was aware of the successful way to attack the problem.

It seems there are three potential scandals here:

1) OpenAI by their own admission chose to try to scoop mathematicians who they had heard had already completed a proof

2) OpenAI may have used a model that had seen "de-identified" messages indicating the direction to take

3) An OpenAI employee essentially threatened to "ruin the career" of the NYU professor who had been working on this if he did not cooperate with them

The direct plagiarism possibility, 2), while it should be a warning to anyone using OpenAI's models, doesn't need to be true for OpenAI to have benefited from the researcher's work. It's enough that they heard Navier-Stokes had been solved and could then go out with their swarm of 10,000 agents and $20M of compute to hunt out the latest research and brute force it.

Magnus Carlson once said that if he wanted to cheat all it would take would be for someone to indicate to him (a wink from someone in the audience perhaps) when a position warranted more time to be spent on it (because there was something important to be found if he did). It seems that, at absolute minimum, this is what OpenAI did here, although in context of math this is not cheating - the "wink" was a rumor, originating from who knows where, that a proof existed (but had not yet been published) and therefore there was potential to rush in and scoop rights to publish or co-publish.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
An Astra sized model takes months to train - they are not saying 2 weeks to train from scratch. The only only interpretation of this "2 weeks" claim that is consistent with reality is that they mean 2 weeks of additional training on top of whatever their starting point was, so it's more like this:

|--- N months of base model training -->|--- X months of post-training -->(Astra?)|-- 2 weeks more training (on Navier-Stokes adjacent material, perhaps)--> this "new" model

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
If there is any truth to this timeline, then presumably it just means an additional 2 weeks of RL training on Astra.

"Twice as capable in mathematics" just means they found some problems that Astra couldn't solve, or make progress on (who knows how they chose to define "capable", or "twice as" for that matter), then put those 2 weeks of training in to focus on those gaps.

At this point, focused on their IPO, the best way to interpret OpenAI press releases is "what is the least this can mean, without being an actual lie". They are not shy - if there was a more impressive claim they could make, they would have made it.

HarHarVeryFunny··on How An AI math breakthrough ignited a controversy
I would think it would have the exact opposite effect.

Why would anyone use OpenAI models for anything commercially valuable, or where secrecy is important, when it appears that if OpenAI "becomes aware" that you are doing so they may try to compete with you?

Not only did OpenAI, by their own admission, rush to re-solve Navier-Stokes once they heard the rumor that it has been solved (the rumor being that it was Anthropic that had done it), but they are leaving the door open ("we cannot rule out that") as to whether the model they used to do it had been trained on the anonymized date from the researchers who's approach they ended up copying.

Terrance Tao has recently said as much for mathematics - that there appears to be a trend (not just this Navier-Stokes incident) of the AI companies going after math problems wherever there is an "rumor" of progress, and that he thinks this may sadly result in breakthrough mathematics being conducted in secret to avoid this.

The rush to steal another researcher's thunder is bad enough, but it also appears that one of OpenAI's employees acted in a very thuggish manner to try to threaten the professor who had been working on this not to publish and to co-operate with their telling of the story.

HarHarVeryFunny··on OpenAI's GPT-6 Astra on ARC-AGI-3
> My point is it's not "gone very far" because he's taking it as far as he can, which isn't very far.

I wouldn't really agree - I'm no fan of LeCun, but the problem with JEPA isn't that it's a bad idea, or can't go very far, but just that it's not much of an idea in the first place!

It's no secret that our brain basically works by prediction, and what we're predicting is necessarily the external world as we perceive it though our own senses, aka latent representations, aka JEPA.

So, you COULD take this unoriginal smidgen of an idea and built it out to a full model of a human/animal brain, whether or not it's LeCun's intention to do so (he seems more interested in just the representational / world model aspect to it), but he certainly hasn't done so yet, nor created any research manifesto indicating that as his intent.

The fact that JEPA implementations to date are using pre-trained Transformers doesn't seem inherent to the approach - one could, with more effort, still predict latent representations (i.e. sensory feedback) but do so using a new real-time learning algorithm based on prediction failure.

LeCun seems more of an academic / research director than a builder, and I would never have put much stock in him being the one to build an animal brain.

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
The NYU professor, Tristan Buckmaster, has now released a statement on this.

https://cims.nyu.edu/~tristanb/statement.pdf

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
Too late - OpenAI already cured cancer, but they are holding the result for their IPO next year.
HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
As a developer yes, especially given that it runs on a PC, and DeepBlue in it's day was really more impressive since is used custom ASICs.

But, I assume the Stockfish developers aren't comparing themselves to Magnus.

Let's see if OpenAI, or someone else, can get these sort of physics/math results out of a desktop PC - that would also be an impressive piece of engineering!

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
What's impressive for a human and for an AI are two different things.

Magnus Carlson had a peak ELO rating of almost 2900.

Would you be impressed with someone with an ELO of 3700?

Would you still be impressed if I told you it was Stockfish?

OpenAI didn't go looking for a tough-for-an-AI problem to solve - they went looking for one that looked like it was easy since it they had heard it had already been solved.

Do you find this impressive?

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
Yes there is - that OpenAI PR says that it was Levent Alpöge, an Anthropic employee, and Tristan Buckmaster, a math professor at NYU.
HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
There are bound to be a bunch more results like this, in math, physics, chemistry, and now that we essentially have a DeepBlue for math, a DeepBlue for physics, etc, these results are going to come.

SOME of the problems that have eluded humans are going to turn out to be low hanging fruit that are susceptible to this type of brute force (10,000 agents on a supercomputer running for 7*24 hours straight) AI search.

I'd be more impressed if OpenAI found their own problems to solve, rather than rushing in to re-solve one once they heard it was already solved (and therefore not so hard).

HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
That's not my interpretation - that is literally what OpenAI say in that press release.
HarHarVeryFunny··on On the Navier–Stokes Millennium Prize Problem
[flagged]
HarHarVeryFunny··on OpenAI's GPT-6 Astra on ARC-AGI-3
You regard the LLM post-training process as "giving it data" ?!

Have you looked at all the published JEPA research both while LeCun was at Meta, and since (up to and including the latest AdaJEPA from June)? Please enlighten us as to exactly which line(s) of research you think were "scaled" at Meta, and then tell us which of these constituted anything even remotely resembling a complete testable intelligence?

FYI, it's been a long time since FaceBook/Meta even had a single head of AI. Since 2018 it has been split into two groups, FAIR and Generative AI, with LeCun being in the FAIR group, not as head, but as Chief AI scientist. LeCun only invented JEPA in 2022 (shortly after FaceBook became Meta), first writing about it in his "A Path Towards Autonomous Machine Intelligence" paper, perhaps unhappy with the work of the GenAI group, which he had no control over, that presumably was getting all the compute.

https://openreview.net/pdf?id=BZ5a1r-kVsf

> What are you talking about?

I was referring to Uszkoreit's personal telling (on YouTube) of the origin story of the Transformer, his motivations with the design, his initial personal failure to implement his idea in a performant enough manner to beat the current LSTM SOTA, and Noam Shazeer then throwing the kitchen sink at it and eventually coming up with the Transformer design.

HarHarVeryFunny··on OpenAI's GPT-6 Astra on ARC-AGI-3
> How is Astra a step change in computer use and spatial reasoning to the extent it can play games and paint good looking stuff with e.g canva ?

Presumably because of pre-release training, because some alien outside of the model, armed with the reinforcement learning algorithm, came in and programmed its weights.

> The architecture that keeps delivering results isn't slowing down ? You don't say

Sure, nothing wrong with that, as long as you don't misrepresent the limitations of the approach.

> There's no shortage of people, even researchers, who for one reason or the other are convinced we are in need of some paradigm shift.

> But guess what? Talk is cheap. You beat the current paradigm or you don't. Do you seriously think that Meta never scaled JEPA ?

The idea has not been taken very far, so what is there to scale? It's not a complete cognitive architecture. So far it's also been using a pre-trained transformer as the learning component, which makes it of limited interest.

The animal intelligence approach, even in it's most fledgling form (that you would apparently dismiss), requires a complete agentic architecture, including new learning algorithms and generative behavior, before it can be compared to LLMs. We know that, done right, our brain architecture is more capable than an LLM, so even if any hypothetical attempts to reproduce it were not highly performant, we know that the idea itself is sound. You might compare with Uszkoreit's initial poor-performing implementation of his new language model architecture - should he have given up?

HarHarVeryFunny··on Research acceleration: The view inside OpenAI
The "You can loop forever using output as input but at some point the result will stop changing" idea seems more related to dynamics, feedback and attractor states.

If you have a feedback loop of "recursively improving" by generating synthetic data, to train on, to generate more synthetic data, etc, then this is indeed a matter of looping "using output as input", and without any other system inputs it would indeed "converge" to some attractor states.

HarHarVeryFunny··on Robot writes in languages it has never seen before (2019)
The headline "taught to do A, but can also do B", is trying to present this as something unexpected or story-worthy.
← PreviousPage 14 of 34Next →