I have read in a Deepmind Blog post, that language model AIs gives more reliable and correct answers, if it is forced into some Chain-of-thought prompt. Especially for questions, which involve math.
Something like "Think about it first, before you give the answer". Could it be that ChatGPT is being forced in this direction?