Evaluation of OpenAI O1: Opportunities and Challenges of AGI
arxiv.org
arxiv.org
"AGI-Benchmark 1.0 is designed to assess a model’s ability to tackle intricate, multi-step reasoning problems across a diverse set of domains."
See pp 13-14 for the list of tasks in 27 categories. It's diverse indeed.