It’s my understanding this model has even fewer of those than the models with higher cost per successful task.

As a result, a simple “cost per task” metric makes the most sense to use for me, when paired with the eval scores.