What is AI benchy and why does it rate everything on passing 23 tests? Putting Gemini 3.6 Flash on top of the leaderboard doesn't pass the smell test.
There is no model passing all the tests. Gemini is on top because questions also include general knowledge, trivia or domain-specific questions, which Gemini models are way above any other model.
Even if models have similar scores at the top, it's useful to compare costs/response times.
It's actually quite hard to make a single task/question with few steps max that SOTA models fail on. Gemini are on top, because asking domain specific questions still breaks most top models, but not Gemini ones.
Claude is lower, and also most Antrophic models, because (historically) they have one of the highest refusal rates and also struggled more with precisely following instructions (i.e. outputting in a specific format/way).
Opus 5.5 are best at coding, and even art generation, but struggle a lot with built-in knowledge, when web search is not available.