Normally, the background highlight color indicates the leader for every benchmark, but they chose to highlight their column even though there are better models.
APEX Agents => Claude Fable 5 and Gemini.
Normally, the background highlight color indicates the leader for every benchmark, but they chose to highlight their column even though there are better models.
APEX Agents => Claude Fable 5 and Gemini.
500px of the landing page is dedicated to share how they're more "token efficient" than the base model they used. Apparently this -6.5% difference is worth highlighting as the very top feature of this fine-tune they've made.
How much is 6.5% percent concretely though? Assuming the six benchmarks have ~30 tasks each (180 in total), and we're doing 120 tok/s lets say, time/task for GLM-5.3 Flash would be ~25 minutes and this "token efficient fine-tune" would arrive at ~23 minutes.
Again, a 6.5% difference is highlighted as the most impactful change for this fine-tune, but it's a marginal difference. They're definitely trying to mislead people into thinking this is something more than it is, otherwise this landing page would have been much more realistic and less self-patted.