Sonnet 5.5 vs Sonnet 5 on Bakeoff (real bugs/features, graded by held-out tests) is a huge upgrade:
* 5.5x faster
* 4x cheaper due to using fewer tokens
* 1/3 the turns: batched reads, one-script edits & tests in the same call
* 5.5x faster
* 4x cheaper due to using fewer tokens
* 1/3 the turns: batched reads, one-script edits & tests in the same call
No comments yet.