HNHacker News
TopNewBestAskShowJobs

HoshinoAI

4 karma · joined May 3, 2023

submissionscomments
HoshinoAI··on Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings
check matchmaking section: https://www.dota2.com/newfrontiers

Valve listed some reason for making the change.

https://en.wikipedia.org/wiki/Glicko_rating_system

HoshinoAI··on Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings
It's glad to see the old technique is used for new models.

You may also learn from 7.33 dota update which uses a new ranking algorithm called Glicko.