For example there's nothing inherent to token prediction to make it capable of doing arithmetic and you wouldn't expect a small/briefly trained model to manage it. But if learning a very large model on a huge dataset leads to it "learning" the decimal number system and arithmetic via token prediction then that is an emergent capability.
It's just like the Chinese Room thought experiment - https://en.wikipedia.org/wiki/Chinese_room#Chinese_room_thou...
There are large datasets of calculations specifically for training large language models. It’s not just picking it up from reading books. And even then these models suck at calculating, half the time they just make an answer up.
Calculation appears to be something that is actually not an emergent property of constant-time token prediction. Which we already knew from Turing anyway.
...aren't we just witnessing proof that this is wrong? Apparently those abilities are inherent to token prediction models with sufficient parameter size.
To be truly emergent in your sense it seems an LLM would have to make a new discovery, i.e., have scientist-level intelligence. That bar keeps moving up.
Something like this may well yet emerge if a new AI agent learns how to combine the properties of a LLM with an algorithmic approach, fact-checking or a general reasoning engine. But for that we are still waiting for another breakthrough to combine these isles into one (without bolting them manually on each other)
100% accuracy on up to 13 digit addition can be taught to 3.5 as is.
https://arxiv.org/abs/2211.09066
And 4 has little need for such out the box
So it's not an emergent property of LLM but 4 new capability trainings. Noone is saying you can't teach these things to an Agent, just that these are not emergent abilities of the LLM training. by default a LLM can only match token proximity, all trainings of LLMs improve the proximity matching (clustering) of token but they do not teach algorithmic reasoning. it needs to get bolted on as addon.
Turing wrote that in 1950, so I suppose his intuition was within a couple of orders of magnitude...
That’s what emergent means. Something scales quantitatively, and after reaching certain levels, without any other special prompting, something else changes qualitatively.
Presumably we recognize these things, then learn something after we have investigated and found out what the new mode of operation is, why it needed what it did to emerge, and possibly find new efficiencies or other ways to amplify the emergent effects.
> [W]e defined an emergent ability as an ability that is “not present in small models but is present in large models.”
It's not a bad study but using that word in that way is extremely poor communication, which has predictably been seized upon by every breathless nontechnical AI enthusiast.