If something is more efficient 95% of the time, and as efficient as normal for the rest of the time, its still a good solution.
86 karma · joined December 25, 2022
on a related note, at what point are people going to get tired of waiting 20s for an llm to answer their questions? i wish it were more common for smaller models to be used when sufficient.
https://imgur.com/a/KzlTbO2 (gpt 5 - yellow plastic)