I facing with this situation too when I working on shared memory for multiple agents from different environments.

At glance that look like it’s great that can remember more complexity of my system but when using it continuously, I found the memories, current state, handoff bills and source of truth that should not using the same ontology.

Retrieval can be perfectly fast and 100% correct, but the agent may still wake up believing it is in the present when it is actually in the past.

Without a human there, how does it know the world has already moved on?