This is completely orthogonal to the inference and training stack that the parent comment mentions
I do believe this will force the AI labs to eventually solve the bloat problem with AI, but we’re definitely not there yet.
Give a verifiable benchmark for the AI agent to hit such as reduce token processing time by 5% without affecting output.
Kernels, performance-required stacks etc. is different, so you optimise them for that.