Don't ask a language model to do math, they're not very good at it.
Next time ask it to write a script or a program to do it, it'll most likely one-shot it.
Next time ask it to write a script or a program to do it, it'll most likely one-shot it.
... and not intelligent enough to know that, apparently.
In theory the "count the 'r's in strawberry" type of things could just be run in the browser, which is a semi-safe environment.
The fact it doesn't know the method it does use is defective is defintely about intelligence.
As is the fact it doesn't learn. If I give it the same task tomorrow, it will repeat the same mistake it admitted yesterday.