41 karma · joined April 26, 2026
Still a bit raw, but getting there
Works fine, yeah it only compresses command output so only input tokens are affected in terms of "compression".
That being said, I do have to wonder why someone as bug as say Uber, simply not rollout OSS model in the cloud for their team, I'd imagine that would be cheapest & most flexible option, while also keeping all the data shared with LLM private.
When it comes to security and AI, all top tier publicly accessible models (GPT 5.5, Opus 4.7) and even near-top like Deepseek 4 PRO can do a very good job given detailed harness on how to spot issues and cross-validate them to avoid false positives.
Forgetting other categories for a moment, the fact that corp operations are nearly 2x the money going to linux kernel says it all...
Low key wonder if people using LLMs to scan these old code bases for corner case issues and fining treasure troves of exploits.