That's already true.. Every time a new "benchmark-leading" model is released from anyone, they give it maximum resources for a week or two, then drop the performance. The point is no-one can reliably use these already unreliable and inconsistent tools when the vendors are making it worse by fiddling in the backend. Claude went from useful to near useless for me in a week, with no otherwise visible change. The produce being sold is literally changing under the hood on a whim. This is a deceptive trade practice, but on a more practical level, it's just not possible to get consistent results with these products when their output quality is so subject to change.