Hacker News Reader

Comment by anotherpaulg | Hacker News Reader

For AI coding, o3-mini scored similarly to o1 at 10X less cost on the aider polyglot benchmark [0]. This comparison was with both models using high reasoning effort. o3-mini with medium effort scored in between R1 and Sonnet.

  62% $186 o1 high
  60%  $18 o3-mini high
  57%   $5 DeepSeek R1
  54%   $9 o3-mini medium
  52%  $14 Sonnet
  48%   $0 DeepSeek V3

[0] https://aider.chat/docs/leaderboards/

View on HN

Do you have plans to try o3-mini-high as the architect and Sonnet as the model?

You're conflating the low price of the o3-mini medium effort model with the high performance of the o3-mini high effort model. OpenAI hasn't listed the price for the o3-mini high effort model separately on their pricing page.

If they are the same underlying model, it’s unlikely the prices will be different on a per token basis. The high model will simply consume more tokens.

You're right but then in that mode it's no longer cheap.

Also Gemini API is free for coding.

I have yet to see a valid reason to use Gemini over any other alternative, the only exception being large contexts.

Large context are a huge reason

2 million tokens context windows separates it from all other LLMs.

What do you expect to come from full o3 in terms of automating software engineering?

o3 (high) might score 80%+

Reply on news.ycombinator.com