Didn’t anthropic show that the models engage in a form of planning such that it is predicting a possible future subsequent tokens that then affects prediction of the next token:
https://transformer-circuits.pub/2025/attribution-graphs/bio...
Causality is enforced in LLMs - past tokens can affect future tokens, but not the other way around.