I've said this over and over again: there are no emergent abilities.
Before you leap to link me this paper, I'll link it myself: https://arxiv.org/abs/2206.07682
I read that paper. Did you? Did you understand it? Because if you had, you'd have seen that early on they define what they mean when they say "emergent abilities", and it's not what almost anyone else means when they say "emergent abilities". They're not claiming that the abilities of LLMs are anything more than the sum of their parts.
"Emergent abilities" in that paper is an extraordinarily poor communication of the idea that larger models can do more than smaller models, which should be a surprise to no one.
Stop spreading this nonsense.
I'm not saying that LLMs aren't impressive. I'm just saying this breathless fantasy where they're doing totally unexpected and unexplained things that are beyond human understanding, is totally false.
Since this is controversial and seemingly most HN folks can't hold a conversation with any nuance, if you don't use the word "shape" in your response to this post, I'm simply going to point out that you didn't read the post you're responding to, and therefore shouldn't be responding. If you stop reading at the first chance you see to correct something, go away--you're dragging down the level of the conversation.