1. An input is processed with answer generated token-by-token.
2. The model can output based on probability the answer or a filler token. Low probability answers are ignored in favour of higher probability filler tokens (I don't have a better token to answer with than .....)
3. At a certain point, an alignment is made with what was learnt previously triggering a higher probability of outputting a better token.
This intuition being that I've noticed models respond differently based on where in context information appears: Can't speak for different embedding methods however as I'm sure this changes my thoughts on above.
If instead chain of thought prompting is used, the tokens further generated may interfere with the output probability.
So further to this, I'm thinking filler tokens allow for a purer ability for a model to surface the best answer it has been trained on without introducing more noise. Or we can use methods that resample multiple times to find the highest outputs.
These LLMs are practically search engines in disguise.