1,454 karma · joined September 24, 2015
But, yeah, priority is much more finicky. The Newton/Leibniz drama was quite something.
BTW, there's also a problem of asking interesting questions that AIs aren't yet good at.
No one has found any principled walls of AI development yet. And empirical results are quite telling. So, I guess, those problems will not stand for long.
Robots don't need that much intelligence. High-speed joint control, "hand-eye coordination", the higher level tasks can be delegated to external models. Distillation already works quite well for isolating the required functionality.
Etching a model's weights on silicon is another way to utilize non-top-notch tech-processes, while maintaining or improving performance. (and it suits robotics well)
How do you think why there's this fad of producing general purpose humanoid robots?
[1] https://waymo.com/blog/2025/12/demonstrably-safe-ai-for-auto...
It's a sarcastic take and I understand that you are probably talking about "spiky intelligence", but you've chosen unsolved problems as a measure of the progress yourself.
They work on a problem until their brain is full of problem-related concepts. Then something comes. After validation it might be a solution.
Fixed weights don't preclude in-context learning and out-of-the-loop weight updates. And that's the only principled limitation mentioned in the post.
When told to a statistically illiterate person who isn't aware of Simpson's paradox and so on?
That's unrealistic. Climate models aren't good enough to predict the regional-level consequences of large-scale interventions (not to mention that scientists are people, and they might be averse to creating an international flashpoint).
Realistically, it will create/exacerbate international tensions. The monsoon/desertification will be linked to geoengineering with or without scientific consensus and whether or not they were really caused by geoengineering.
As the climate models improve by incorporating active intervention data it will be possible to decrease adverse consequences.
It's a risky approach, but, when the consequences of climate change will become undeniably bad, some countries/individuals might try.
But, yeah, I agree with you in the end.
If you are able to check that the results of an LLM are satisfactory, it means that the results are checkable. Then, in retrospect, the process of LLM coming up with those results is rule-based, because an LLM is a large set of data manipulation rules.
In short, which concrete thing that an LLM does would surprise you?
I don't know how it gets from physical processes or informational processing to our first-hand experiences. So, I can't be sure that a bunch of high-dimensional vectors can't lead to experiences.
Regardless, the claim "LLMs deal entirely in symbols" is wrong as a matter of fact.