Then how did we develop predictive systems just by observing those outputs?
Then how did we develop predictive systems just by observing those outputs?
https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+docume...
The reason I linked that article is that all the inputs are outputs of the network, so by definition it's training on just outputs (under my personal definition of outputs).
That proves in general these LLMs can't compose knowledge, unless it has seem a lot of examples of similar compositions before. That is a massive problem and why I believe LLMs will never reach AGI, you need something more.
Me
what is the seventh letter in the word "blueberry"?
ChatGPT
The seventh letter in the word "blueberry" is "r".
Of course, maybe LLM world models are not sufficiently rich or general enough to be a true general intelligence, but no one's proven that last I checked.