LLMs already do this in their own way. It's not like they learn to predict through magic osmosis. They make predictions and depending on how right or wrong they are, their neurons are shifted by grad descent to accommodate this error. Then they predict again.

The Text is the environment, The Text is the world and they are very much interacting with it.