Prediction certainly is one of the things we do with language. That doesn't mean it is the only thing!
It's my contention that most of the behavior people are excited about LLMs exhibiting is really still human behavior that was captured and saved as data into the language itself.
LLMs are not modeling grammar or language: they are modeling language examples. Human examples. Language echoes human thought, so it's natural for a model of that behavior (a model of humans using language) to echo the same behavior (human thought).
Let's not forget, as exciting as it may be, that an echo is not an emulation.
It makes complete sense you would have an idea of the next word in any sentence and some brain machinery to make that happen.
It in no way means you’re just a LLM
"and some brain machinery to make that happen" - Getting close to not having a lot of "brain machinery" left that is still a mystery. Pretty soon we'll have to accept that we are just biological machines (albeit in the form of crap throwing monkeys), built on carbon instead of silicon, and we run a process that looks a lot like large scale neural nets, and we have same limitations, and how we respond to our environment is pre-determined.
If someone says "Computers will never be smarter than humans", then sure go ahead, post it. But most of the time it is just repeated whenever someone says that ChatGPT could be made smarter, or there is some class of problem it struggles with.
The objection people would come with then is something like "but we could add those other systems to an LLM, it is no different from a human!". But then the thesis would be "humans are no different from an LLM connected to a whole bunch of other systems", which is no different from saying "some parts of human thinking works like an LLM" as I suggested above.
Recently stuff like ChatGPT is challenged by people pointing out the nonsense it outputs, but it has no way of knowing whether either of its training input or its output is valid or not. I mean one could hack the prompt and make it spit out that fire is cold, but you and I know for a fact that it is nonsense, because at some point we challenged that knowledge by actually putting our hand over a flame. And that's actually what kids do!
As a parent you can tell your kid not to do this or that and they will still do it. I can't recall where I read last week that the most terrible thing about parenting is the realisation that they can only learn through pain... which is probably one of the most efficient feedback loops.
Copilot is no different, it can spit out broken or nonsensical code in response to a prompt but developers do that all the time, especially beginners because that's part of the learning process, but also experts as well. Yet we somehow expect Copilot to spit out perfect code, and then claim "this AI is lousy!", and while it has been trained with a huge body of work it has never been able to challenge it with a feedback loop.
Similarly I'm quite convinced that if I were uploaded everything there is to know about kung fu, I would be utterly unable to actually perform kung fu, nor would I be able to know whether this or that bit that I now know about kung fu is actually correct without trying it.
So, I'm not even sure moving goal posts is actually the real problem but only a symptom, because the whole thing seems to me as being debated over the wrong equivalence class.
Typical LLM AI has been trained for the equivalent of many person-years. How long would it have taken us to read terabytes of information?
> Pretty soon we'll have to accept that we are just biological machines
But what is the code running on those machines?
That's what you are missing. If the mechanics of the machine are a mystery, you will never read the code.
You didn't find the solution, you found your lack of a solution.
No it isn't - his entire argument is that LLM != Humans, just because LLM can do some human like thinhgs. Pointing out the differences isn't moving the goalposts - it's proving the point.
> Pretty soon we'll have to accept that we are just biological machines
Sounds strawmanish, humans != LLM doesn't mean humans == magic.
> and how we respond to our environment is pre-determined
What does this even mean ? Even these models are stochastic.
You seem to be strawmaning that and bringing up almost tautological "once we advance enough towards AGI we will have human level intelligence".
ChatGPT/LLM has a lot of hype - they are fundamentally not human level intelligence.
Some of the biological details are a mystery too. Just recently a 4th brain membrane was discovered:
What I'm getting at is, membranes are cool, I'm not personally very motivated by them.
"This is moving the goal posts"
<insert argument that implies there should be no goal posts>
<insert some uncritical and speculative extrapolation of current AI abilities arbitrarily far into the future>
Honestly, now whenever I see the word "goal post" my eyes glaze over because I already know exactly what's coming next.
Can't find this exact quote anywhere. Who ever said anything like that?
Everyone forms those predictions, it's how they come to an understanding of what was just said. You don't necessarily memorize just the words themselves. You derive conclusions from them, and therefore, while you are hearing them, you are deriving possible conclusions that will be confirmed or denied based on what you hear next.
I have an audio processing disorder, where I can clearly hear and memorize words, but sometimes I just won't understand them and will say "what?". But sometimes, before the other person can repeat anything, I'll have used my memory of those words to process them properly, and I'll give a response anyway.
A lot of people thought I just had a habit of saying "what?" for no reason. And this happens in tandem with tending to complete any sentences I can process in time...
What's it called? I do this sometimes also and I'd like to know more.
I think it's called "Auditory Processing Disorder"[0]. I'm pretty sure it has to do with me being autistic. I've done hearing tests before and my hearing is just fine, it's just processing what I hear that is the problem.
"Sometimes saying [“huh,” “what,” or “I don’t understand”] and then immediately responding appropriately"[1] is exactly what happens with me.
[0]: https://en.wikipedia.org/wiki/Auditory_processing_disorder
[1]: https://www.vocovision.com/resources/parents/auditory-proces...
Not sure if I'd qualify for a diagnosis, but either way, it's cool to have confirmed that such experiences are 'a thing'.
I also only noticed because people would ask me to stop saying it, and then I would immediately say it anyway because it wasn't compulsive and I really couldn't tell that I was right about to understand what they said. I hadn't yet figured out that there was just a delay sometimes.
This is not how science works.
These papers suggest we are just predicting the next word:
https://www.psycholinguistics.com/gerry_altmann/research/pap...
https://www.tandfonline.com/doi/pdf/10.1080/23273798.2020.18...
https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2009...
https://www.earth.com/news/our-brains-are-constantly-working...
Similarly if LLMs can be used to model human intelligence, and predict and manipulate human behaviour, it'll be good enough for corporations to exploit.
If you are correct about LLMs being a generally complete model, then that is a good prediction. But only if you are correct.
What I see you doing here is personifying the model, and drawing conclusions from the personification.
There is more to how we interact with language than prediction of repitition. You didn't predict anything I have said so far! Yet we are both interacting with the language.
We didn't just model LLMs after our brains, either. We pointed them at examples of thought, all neatly organized into the semantic relationships of grammar and story.
Don't ignore the utility of language: it stores behavior, objectivity, and interest.
> This computational organization is at odds with current language algorithms, which are mostly trained to make adjacent and word-level predictions (Fig. 1a)
I feel like you're suggesting because humans != LLMs then humans cannot be doing next word prediction.
I see GP suggesting that because humans!= LLMs that "doing word prediction" is not an exhaustive list of human behavior.