HNHacker News
TopNewBestAskShowJobs

nopinsight

7,312 karma · joined March 14, 2009

Co-Founder of a stealth startup

Working on:

agentic systems, natural language understanding, machine learning

Comments here do not represent any companies or organizations I am associated with.

Email: My username at the best known email service beginning with g.

submissionscomments
nopinsight··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
Figure 1 shows a significant improvement of o1-preview over earlier models.

Perhaps it’s better that you ask a statistician you trust.

nopinsight··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
If we talk about a median well-educated human, o1 likely passes the bar. Quite a few tests of reasoning suggests that’s the case. An example:

“Preprint out today that tests o1-preview's medical reasoning experiments against a baseline of 100s of clinicians.

In this case the title says it all:

Superhuman performance of a large language model on the reasoning tasks of a physician

Link: https://arxiv.org/abs/2412.10849”. — Adam Rodman, a co-author of the paper https://x.com/AdamRodmanMD/status/186902305691786464

—-

Have you tried using o1 with a variety of problems?

nopinsight··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
Dario said in mid-2023 that his timeline for achieving "generally well-educated humans" was 2-3 years. o1 and Sonnet 3.5 (new) have already fulfilled that requirement in terms of Q&A, ahead of his earlier timeline.
nopinsight··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
Superintelligence (along with some definitions): https://en.wikipedia.org/wiki/Superintelligence

Also, "Dario Amodei says what he has seen inside Anthropic in the past few months leads him to believe that in the next 2 or 3 years we will see AI systems that are better than almost all humans at almost all tasks"

https://x.com/tsarnick/status/1881794265648615886

nopinsight··on Stargate Project: SoftBank, OpenAI, Oracle, MGX to build data centers
The goal is Artificial Superintelligence (ASI), based on short clips of the press conference.

It has been quite clear for a while we'll shoot past human-level intelligence since we learned how to do test-time compute effectively with RL on LMMs (Large Multimodal Models).

nopinsight··on Common misconceptions about the complexity in robotics vs. AI (2024)
It's far from obvious that thought space is much less complex than physical space. Natural language covers emotional, psychological, social, and abstract concepts that are orthogonal to physical aptitude.

While the linguistic representation of thought space may be discrete and appear simpler (even the latter is arguable), the underlying phenomena are not.

Current LLMs are terrific in many ways but pale in comparison to great authors in capturing deep, nuanced human experience.

As a related point, for AI to truly understand humans, it will likely need to process videos, social interactions, and other forms of data beyond language alone.

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Walking is indeed a complex skill. Yet some animals walk minutes after birth. Human babies are most likely born premature due to the large brain and related physical constraints.

Young children learn to bike or skate at an older age after they have acquired basic physical skills.

Check out the reference to Core Knowledge above. There are things young infants know or are predisposed to know from birth.

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
The brain is predisposed to learn those skills. Early childhood experiences are necessary to complete the training. Perhaps that could be likened to post-training. It's not a one-to-one comparison but a rather loose analogy which I didn't make it precise because it is not the key point of the argument.

Maybe evolution could be better thought of as neural architecture search combined with some pretraining. Evidence suggests we are prebuilt with "core knowledge" by the time we're born [1].

See: Summary of cool research gained from clever & benign experiments with babies here:

[1] Core knowledge. Elizabeth S. Spelke and Katherine D. Kinzler. https://www.harvardlds.org/wp-content/uploads/2017/01/Spelke...

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Many of humans' capabilities are pretrained with massive computing through evolution. Inference results of o3 and its successors might be used to train the next generation of small models to be highly capable. Recent advances in the capabilities of small models such as Gemini-2.0 Flash suggest the same.

Recent research from NVIDIA suggests such an efficiency gain is quite possible in the physical realm as well. They trained a tiny model to control the full body of a robot via simulations.

---

"We trained a 1.5M-parameter neural network to control the body of a humanoid robot. It takes a lot of subconscious processing for us humans to walk, maintain balance, and maneuver our arms and legs into desired positions. We capture this “subconsciousness” in HOVER, a single model that learns how to coordinate the motors of a humanoid robot to support locomotion and manipulation."

...

"HOVER supports any humanoid that can be simulated in Isaac. Bring your own robot, and watch it come to life!"

More here: https://x.com/DrJimFan/status/1851643431803830551

---

This demonstrates that with proper training, small models can perform at a high level in both cognitive and physical domains.

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Their reasoning models can learn from procedures and methods, which generalize far better than data. Software tasks are diverse but most tasks are still fairly limited in scope. Novel tasks might remain challenging for these models, as they do for humans.

That said, o3 might still lack some kind of interaction intelligence that’s hard to learn. We’ll see.

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Thanks! I added some comments on this at the bottom of the post above.
nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Thanks! I've analyzed some easy problems that o3 failed at. They involve spatial intelligence including connection and movement. This skill is very hard to learn from textual and still image data.

I believe this sort of core knowledge is learnable through movement and interaction data in a simulated world and it will not present a very difficult barrier to cross.

(OpenAI purchased a company behind a Minecraft clone a while ago. I've wondered if this is the purpose.)

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Great point. I'd love to see what these easy tasks are and would be happy to revise my hypothesis accordingly. o3's intelligence is unlikely to be a strict superset of human intelligence. It is certainly superior to humans in some respects and probably inferior in others. Whether it's sufficiently generally intelligent would be both a matter of definition and empirical fact.
nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
I'd need to see what kinds of easy tasks those are and would be happy to revise my hypothesis if that's warranted.

Also, it depends a great deal on what we define as AGI and whether they need to be a strict superset of typical human intelligence. o3's intelligence is probably superhuman in some aspects but inferior in others. We can find many humans who exhibit such tendencies as well. We'd probably say they think differently but would still call them generally intelligent.

nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
One possibility is that it may not yet have sufficient experience and real-world feedback for resolving coding issues in professional repos, as this involves multiple steps and very diverse actions (or branching factor, in AI terms). They have committed to not training on API usage, which limits their ability to directly acquire training data from it. However, their upcoming agentic efforts may address this gap in training data.
nopinsight··on OpenAI O3 breakthrough high score on ARC-AGI-PUB
Let me go against some skeptics and explain why I think full o3 is pretty much AGI or at least embodies most essential aspects of AGI.

What has been lacking so far in frontier LLMs is the ability to reliably deal with the right level of abstraction for a given problem. Reasoning is useful but often comes out lacking if one cannot reason at the right level of abstraction. (Note that many humans can't either when they deal with unfamiliar domains, although that is not the case with these models.)

ARC has been challenging precisely because solving its problems often requires:

   1) using multiple different *kinds* of core knowledge [1], such as symmetry, counting, color, AND

   2) using the right level(s) of abstraction
Achieving human-level performance in the ARC benchmark, as well as top human performance in GPQA, Codeforces, AIME, and Frontier Math suggests the model can potentially solve any problem at the human level if it possesses essential knowledge about it. Yes, this includes out-of-distribution problems that most humans can solve.

It might not yet be able to generate highly novel theories, frameworks, or artifacts to the degree that Einstein, Grothendieck, or van Gogh could. But not many humans can either.

[1] https://www.harvardlds.org/wp-content/uploads/2017/01/Spelke...

ADDED:

Thanks to the link to Chollet's posts by lswainemoore below. I've analyzed some easy problems that o3 failed at. They involve spatial intelligence, including connection and movement. This skill is very hard to learn from textual and still image data.

I believe this sort of core knowledge is learnable through movement and interaction data in a simulated world and it will not present a very difficult barrier to cross. (OpenAI purchased a company behind a Minecraft clone a while ago. I've wondered if this is the purpose.)

nopinsight··on Alignment faking in large language models
This product launch statement is but an example of how LMMs (Large Multimodal Models) are more than simply word salad generators:

“We’re Axel & Vig, the founders of Innate (https://innate.bot). We build general-purpose home robots that you can teach new tasks to simply by demonstrating them.

Our system combines a robotic platform (we call the first one Maurice) with an AI agent that understands the environment, plans actions, and executes them using skills you've taught it or programmed within our SDK.

If you’ve been building AI agents powered by LLMs before, and in particular Claude Computer use, this is how we intend the experience of building on it to be, but acting on the real world!

…

The first time we put GPT-4 in a body - after a couple tweaks - we were surprised at how well it worked. The robot started moving around, figuring out when to use a tiny gripper, and we had only written 40 lines of python on a tiny RC car with an arm. We decided to combine that with recent advancements in robot imitation learning such as ALOHA to make the arm quickly teachable to do any task.”

https://news.ycombinator.com/item?id=42451707

nopinsight··on Alignment faking in large language models
It's a different founder. Also, this founder clearly limited the scope to junior engineers specifically because of their experiments with Devin, not all positions.
nopinsight··on Alignment faking in large language models
> I still tend to think of these things as big autocomplete word salad generators.

What exactly would be your bar for reconsidering this position?

Taking some well-paid knowledge worker jobs? A founder just said that he decided not to hire a junior engineer anymore since it would take a year before they could contribute to their code base at the same level as the latest version of Devin.

Also, the SOTA on SWE-bench Verified increased from <5% in Jan this year to 55% as of now. [1]

Self-awareness? There are some experiments that suggest Claude Sonnet might be somewhat self-aware.

-----

A rational position would need to identify the ways in which human cognition is fundamentally different from the latest systems. (Yes, we have long-term memory, agency, etc. but those could be and are already built on top of models.)

[1] https://www.swebench.com/

nopinsight··on FastVideo: a lightweight framework for accelerating large video diffusion models
Have you seen Veo 2 just launched by Google? Its quality and physics understanding appear far ahead of the competition.

https://deepmind.google/technologies/veo/veo-2/

Also, planning might be around the corner with test-time compute applied to video generation.

nopinsight··on Ilya Sutskever Test of Time Talk "Pre-training as we know it will end"
> There's a lot of things that we know how to fix, but cannot.

This assumes that humanity would remain in control after ASI emerges. We might not.

nopinsight··on Ilya Sutskever Test of Time Talk "Pre-training as we know it will end"
Resources will surely impact near-term possibilities.

The space of possibilities is probably large enough that, given time, ASI can get around most limitations if it has the desire/goal to implement them.

nopinsight··on Sequence to sequence learning with neural networks: what a decade
I think it's a matter of magnitude and semantics. It was quite predictable that the Internet would take off, become ubiquitous, and highly influential.

If superintelligence emerges soon, we may not even know which technologies will emerge and how many will be unleashed in the next 2 decades.

ADDED: Examples of some concrete predictions:

(1980) https://en.wikipedia.org/wiki/The_Third_Wave_(Toffler_book)

(1995) https://en.wikipedia.org/wiki/The_Road_Ahead_(Gates_book)

Obviously, specifics differ from predictions and plenty of people got it wrong. Many good forecasters got the broad strokes right though.

Which forecasters can even predict most technologies that would be invented after ASI emerges?

nopinsight··on Sequence to sequence learning with neural networks: what a decade
An important point from this talk:

The better the models are at reasoning, the less predictable they become.

This is analogous to top chess engines which make surprising moves that even human super grandmasters can't always understand.

Thus, the future will be unpredictable (if superintelligence takes control).

Link to the full talk & the time he talks about this: https://youtu.be/1yvBqasHLZs?si=3M6eZCQtXnW2tSUd&t=866

nopinsight··on GM exits robotaxi market, will bring Cruise operations in house
With world models like Genie 2 and other advances in LMMs (large multimodal models), the aspiration of human-level autonomous vehicles might be realized relatively soon.

https://deepmind.google/discover/blog/genie-2-a-large-scale-...

nopinsight··on Genie 2: A large-scale foundation world model
The real goal of this research is developing models that match or exceed human understanding of the 3D world -- a key step toward AGI.

A key reason why current Large Multimodal Models (LMMs) still have inferior visual understanding compared to humans is their lack of deep comprehension of the 3D world. Such understanding requires movement, interaction, and feedback from the physical environment. Models that incorporate these elements will likely yield much more capable LMMs.

As a result, we can expect significant improvements in robotics and self-driving cars in the near future.

Simulations + Limited robot data from labs + Algorithms advancement --> Better spatial intelligence

which will lead to a positive feedback loop:

Better spatial intelligence --> Better robots --> More robot deployment --> Better spatial intelligence --> ...

nopinsight··on Build network societies, not network states
Modern colleges, startup incubators, professional associations are some examples of cliques that are better than mafia. I guess a key is that these cliques do not completely encompass every aspect of a member's life and do not use violence as a means to enforce their rules.
nopinsight··on Build network societies, not network states
Cliques will certainly differ from one another and are likely to be unequal, much like “soft cliques” already exist today in larger cities. The question is more about how much power a clique should have and how exclusive and encompassing its membership should be, e.g., whether a person can belong to multiple cliques.
nopinsight··on Build network societies, not network states
Freedom of association means that a clique does not have absolute power over you, right? Competition implies that cliques incompatible with most people’s values will wither.

You can possibly live in the same house. It’s a bit like changing your insurance company or gym membership but with much larger consequences, if I understand the concept correctly (I’ve never read the novels mentioned).

nopinsight··on Transcript: Ezra Klein Interviews Dario Amodei, Anthropic's CEO and Co-Founder
I prompted Claude 3.5 Sonnet with "Please summarize Dario's view on upcoming AI progress in his interview as attached into 100-200 words."

-----------

Dario Amodei, CEO of Anthropic, believes AI is on an exponential growth curve where capabilities are increasing rapidly and predictably. He sees major developments happening in very short timeframes - within 2-5 years rather than decades. According to Amodei, we're at "AI Safety Level 2" now, but could reach ASL 3 (where AI poses serious biosecurity risks) this year or next, and ASL 4 (where AI could significantly enhance state-level military capabilities) between 2025-2028.

He expects AI models to become increasingly powerful and expensive, with training costs rising from current ~$100 million to $1 billion in the next year, and potentially $5-10 billion by 2025-2026. Amodei believes AI will soon be able to take complex autonomous actions in the real world, with capabilities emerging in the next 3-24 months.

While optimistic about AI's potential benefits, he expresses serious concerns about safety and governance, suggesting that at some point the technology may become too powerful to remain solely in private hands. However, he acknowledges there's no clear solution for how to manage this transition.

← PreviousPage 4 of 34Next →