"Except for the not saying it part" is interesting. I wonder if that's because these LLMs can't "think", they can only generate text; in order to perform a multi-step algorithm, it must write the result of one step in order for it to become an input to the next step.