That’s the thing. LLMs don’t have any logical ability. Only predictive ability. They’re not the same. And that’s why LLMs are a) unreliable and b) not a path to AGI.
How do you know that human logic is any more/better/qualitatively different from the LLMs "predictive ability"? It's already pretty easy to find humans that are strictly worse at reasoning and logic than a decent LLM.