Also, the tests seem to be heavily skewed in favor of what LLMs are good at.
Reply on news.ycombinator.com