This paper very clearly demonstrates these LLMs are not reasoning in a fundamental way. Token prediction and reasoning are two different tasks. They may be related, but they are not the same. "Just wait for GPT 5, it will be amazing!" is part of the hype.
Please do not assume an LLM is correct in skill or knowledge unless you already know the answer or can verify by other means.