ParentFull threadcyanf·They’re using the FS for caching the KV caches of past requests. It’s why they’re able to charge so little on prompt cache hit.View on HN