ParentFull threadjpgvm·Ahh I missed that. Yes prefix caching and RAG are 2 cases were you will want something like this during inference time.View on HN