> Results: both o1 models beat GPT-4o. And o1-preview is on par with Claude 3.5 Sonnet.
> o1's performance increase did come with a time cost. It took 70 hours on the 400 public tasks compared to only 30 minutes for GPT-4o and Claude 3.5 Sonnet.
See details at https://arcprize.org/blog/openai-o1-results-arc-prize
Also discussed here: https://news.ycombinator.com/item?id=41535694