https://chatgpt.com/share/6814e827-81cc-8001-a75f-64ed6df5fc...
https://chatgpt.com/share/6814e7fb-f4d0-8001-a503-9c991df832...
if you think about how these things work as services you can see that this makes sense. The model weights are several gb, so caching the model weights for utilisation by a particular customer is impractical. So if the forward pass does update the model then that's instantly discarded, what's retained is the conversational text, and that's the bit that's uploaded to the model on each iteration for a new reply. There are hundreds of requests pinging through the data center where the models are used every second, all of these use the same models.
But if you believe that there is a reasoning process taking place in the text then fair enough.