> it'll be outgunned by something that just leverages raw computation better.

The issue for me is that the raw computation is coming at the cost of the planet. Throwing an aircraft carrier at a problem that needs a bicycle is dumb, but because the damage to the environment required to scale up computation isn't included in the price of that computation - it's easier to just toss the aircraft carrier at every little problem.

So when I say I want to pick and choose, and use smaller models, it's because I like technology and I don't want to hate LLMs, but I also like the planet and don't want LLMs to continue to accelerate environmental collapse.