News for hackers. Stuff that matters.
Re:Up to date prices for LLM APIs all in one place by alexellman on Friday July 25, 2025 @09:56AM (#44683170)
They all tokenize a little differently so they are not exactly 1-1. However I plan on addressing this by having each model complete a test task and getting the actual price from each api + token count to make a real 1-1 comparison.
Re:Up to date prices for LLM APIs all in one place by esafak on Friday July 25, 2025 @10:48AM (#44683772)
And please timestamp the benchmarks, and rerun them periodically, so vendors can't quietly cost optimize the model when no-one's looking.
Re:Up to date prices for LLM APIs all in one place by nisegami on Friday July 25, 2025 @09:57AM (#44683193)
Ah, that's a great idea and would be a welcome addition to the site.