There might be no reasoning in a single pass which outputs a single token. But in the loop where the output of the LLM repeatedly gets fed back into its input, reasoning is clearly happening:

The LLMs lay out how to go about figuring out the answer, do a series of calculation steps and then come up with an answer.

If you add "Please answer in just one short sentence." to the prompt, even the top ones get it wrong.