ParentFull threadgeorge_123·this approach to managing KV cache can work with 4bit. imagine the speedup of pagedattention with quantization..View on HN