Something like this might work well for managing long context for LLMs!