Memorilla: Latent Semantic Memory for LLMs

Memorilla, a memory system that gathers information from an entire document collection into a fixed number of query-dependent memory tokens for a frozen LLM.