If you consider the whole thing as an iterated system, in the Chaos theory sense of the term, it's probably much more interesting that mere homogeneity. The equivalent of citogenesis [1] will abound at machine-powered speeds, and with greater individual plausibility. In a few select places, entire fictional concepts will be called into existence, possibly replacing real ones. It's likely most places will look normal, too. It won't be a simple situation that can be characterized easily with everything being wrong or dumbed down or anything like that, it'll be a fractal blast of everything, everywhere.
[1]: https://en.wikipedia.org/wiki/Wikipedia:List_of_citogenesis_...
Snopes did recently confirm that this video is in fact accurate.
I don’t trust anymore. :-)
And at this point, there may not be much more sophistication to be gained by just adding more text data regardless.
Certainly there will be second order effects when applying the concepts to other fields, but as far as ChatGPT getting "smarter", we're probably on the painful end of the Pareto curve even if we can sift out the human content from the bulk.
The initial data set was essentially created by undiscriminatingly crawling the internet. This worked reasonably well because up until now most of the internet was - in one way or another - created by humans. This is no longer the case, as LLMs are incredibly attractive when you want to create spam.
Anyone who wants to get any general dataset past 2022 will have to deal with the reality that a significant amount of crawled content will have been written by a LLM and is therefore essentially unusable for training. Facts are useless when they have been hallucinated!
Very true, I suspect part of the changes at Reddit are being driven by them wanting to hoard their data from AI's et. al or at least make them pay for it.
What would be valuable to sell is the real upvote/downvote information.
I would be more interested to see if all of per-Eternal September Usenet is included or not. Just reprocess the data so they're having friendly chats about vi vs emacs and you don't have to worry about toxicity.
There is consensus that almost all contemporary LLMs are undertrained. See, for example, the Gopher, Chinchilla, and LLaMA papers.
Larger models are easier to train, and there are diminishing returns when you keep training. Thus, to claim SotA performance, researchers tried to optimize for the best performance, given a certain training budget.
The best performance within a certain training budget is achieved by training HUGE models on VAST datasets, for a relatively short amount of time. Almost all models could profit from simply training for longer, but the cost/benefit isn‘t there, if your goal is to achieve the best performance.
This is also why distillation and quantization work so well. Models with more and larger weights are easier to train, but ultimately don‘t utilize all that capacity.
Recently, researchers have begun focussing on inference – rather than training – budgets, in order to make using these models actually viable and profitable in practice.
I.e., what is the best performance we can achieve within a certain computational limit at inference time?
This is mostly done by simply training with more data, for longer.
The argument here is the LLM generated text is now going to enter the corpus, muddying the waters and reducing the quality.
According to this theory we have a built-in faculty for things like language (Chomsky) and how to interact with the world. We haven’t bootstrapped ourselves; that would mean that the Blank Slate theory is true.
Could a human tribe who was raised on a different planet (with completely alien concepts) survive? That’s unclear. Maybe we have evolved to only be able to learn Earth-concepts.
A LLM will parrot what it learned without any understanding, which is unlike a human.
Yeah, about that.
https://v.cx/2010/04/feynman-brazil-education
The parallels to LLMs are rather uncanny, now that I think about it.
It’s not God of the gaps (these fantastic things you cannot explain are because God); it’s AI of the mundane.
Just because someone sometimes says something without understand does not in slightest mean that that is the common occurrence.
Saying "LLMs will never be able to solve programming problems with variable renaming" would be a testable hypothesis. "LLMs cannot reason about recursion" would be a testable hypothesis.
Something like "LLMs can act as if they understand but they don't truly understand" is NOT a testable hypothesis. Neither is "LLMs are different because we possess qualia and they don't". In order for these to be actually saying something, you would need to bring them to conclusions. "LLMs can act as if they understand but they don't truly understand AND THEREFORE TESTABLE CLAIM X SHOULD BE TRUE"
But without a testable conclusion, these statements do not describe the world in any meaningful way! They are what you accuse LLMs of producing - words strung together that seem like they have meaning!
It's difficult to generalize because it can be tuned to do any one thing. It's the whole process of doing anything that requires the full apparatus of a human being, and there is no sign that LLMs are approaching that any time soon.
Which is the other problem. We're talking about what LLM's might one day do, rather than what they currently do. It's entirely possible that one day LLMs will be as flexible as human beings, training themselves for every new scenario. I have reason to doubt it, but the basis of that doubt is only noticing the mechanical difference between brains and LLMs. I cannot prove that the limit cases will remain different.
Oh? I say things only when I don't understand them. Once I understand something, talking about it further seems rather pointless and certainly boring.
Make no mistake, even science isn't immune. We've hoisted ourselves into a conceptual maxima, but we have no idea if it's a dead end or not.
1. https://en.m.wikipedia.org/wiki/M%C3%BCnchhausen_trilemma