StreamCtx

Beyond learning inference optimization, I’d also spend time understanding context management, memory systems, caching, and agent orchestration. Those seem to be becoming important building blocks for production AI systems.

“Relevant to anyone building failure-attribution systems for agent pipelines — black-box distillation techniques here could feed into causal attribution models without needing white-box access to the underlying model.”