Too many benchmark comparisons focus on the best single run. Looking at consistency over time seems to me much more useful than chasing the highest peak performance.
Totally agree. The highest benchmark number is easy to chase. We're more interested in answering a different question: "If I deploy this same VM again next week, what should I expect?" That's the whole reason we keep rerunning the same clusters over time.