It’s my understanding this model has even fewer of those than the models with higher cost per successful task.
As a result, a simple “cost per task” metric makes the most sense to use for me, when paired with the eval scores.
As a result, a simple “cost per task” metric makes the most sense to use for me, when paired with the eval scores.
No comments yet.