If I'm downvoted, I'm downvoted by gullible people ascribing magical properties to LLMs and falling for hype and AI psychosis.
An LLM with CoT is Turing-complete, so there's no wall to its capabilities. There's no theorems that establish limits of reinforcement learning either. There's no evidence of quantum computations in the brain.
All you have is a strong belief.
LLMs do not replicate brain functionality.
> Or the brain itself is magic
The brain itself isn't magic
> An LLM with CoT is Turing-complete,
C++ is Turing complete. Hell, HTML+CSS is Turing complete.
> so there's no wall to its capabilities.
There are multiple well understood and well explained walls and limits to LLM capabilities. And none of those walls, or perceived lack of them, stem from something being Turing complete.
> There's no theorems that establish limits of reinforcement learning either.
There's a very obvious and immediate one: availability and size of training data. And compute. And time.
> There's no evidence of quantum computations in the brain.
What does quantum computation have to do with brains or LLMs?
> All you have is a strong belief.
Says the person who just listed a lot of beliefs in marketing bullshit.
Oh! Do you know how does the brain function? Heck, we don't know in detail how LLMs do their thing. The trivial observation that the brain in not a Turing machine is irrelevant if we are talking about functionality and not computational substrate.
But a Turing machine that implements functionality of a target system is the information-theoretical optimal compression of the data produced by the target system. So it stands to reason that LLMs that need to compress vast amounts of data approximate such a machine.
> C++ is Turing complete. Hell, HTML+CSS is Turing complete.
This is absolutely irrelevant to the question of the limits of LLM training. It's a common surface-level patter matching response, though.
> There's a very obvious and immediate one: availability and size of training data. And compute. And time.
Yeah, practical limitations. And practical results like seven hundred solved math problems show that you need, at least, to stop and think.
> What does quantum computation have to do with brains or LLMs?
If you have to ask that, it means that you haven't dug into all this mess deep enough. Basically, BQP computational complexity class is more powerful than P-class. If the brain employs such computations (although we don't know the appropriate quantum algorithms, so it's just wishful thinking mostly), the corresponding Turing machine is impractically large and slow.
> Says the person who just listed a lot of beliefs in marketing bullshit.
Nah. Learn more.