Does lossy means you may see previous inputs change ?!
Lossy doesn't necessarily imply that it is non-deterministic, just irreversible.
Only the model’s view, doesn’t have to be yours, just like you can participate in a long conversation without perfect memory that might in retrospect slightly differ from a recording.
with the added bonus that these things are unreliable and the compressor could drop important tokens