This error is not nonsensical though as normal elementary kids would make similar error and with good episodic memory the agent will fix itself.
LLMs totally violate our expectations for computers, by being a bit forgetful and bad at maths.
How many dollars per month would someone be willing to spend for a chatbot that has a 3rd graders ability at math? Personally, $0 for me.
But what if it's a PHD Math degrees ability at math? Tons, in some applications it could be worth $100s or $1000s in an enterprise license setting.
But what if it's unpredictably, imperceptibly question to question, 95% PHD and 5% 3rd grader? Again, for me - $0. (not 95% of $1000s, but truly, $0)