Ask chat gpt to explain how K-V caching works. What they are doing is essentially the same thing, with a few more engineering details.