What makes the behavior emergent is that it can't be predicted at training time.
The emergent and unpredictable output is the result of massive vector complexity being encoded.
What makes the behavior emergent is that it can't be predicted at training time.
The emergent and unpredictable output is the result of massive vector complexity being encoded.
You are either being pedantic or missing the point of emergent however.
Yes, it's not some novel unforeseen thing, like a magical Marvel Universe material or some unknown to humanity mode of thinking. Same way when people make something new they still recombine known words, or colors, or physical things in the universe.
It is however new capabilities that is not explicitly in the training set and can't be predicted by it. Like teaching something only calculus training materials and it figures out boolean algebra.
>The emergent and unpredictable output is the result of massive vector complexity being encoded
As opposed to what in humans? God given revelation?
The emergent behaviour is in the training data and/or encoding/training.
So while I agree it is emergent from the complexity, it isn't some unknown mechanism. Just complexity at scale.
So like humans? Like the universe?