News for hackers. Stuff that matters.
Re:Up to date prices for LLM APIs all in one place by pierre on Friday July 25, 2025 @09:44AM (#44683056)
Main issue is that token are not equivalent across provider / models. With huge disparity inside provider beyond the tokenizer model:

- An image will take 10x token on gpt-4o-mini vs gpt-4.

- On gemini 2.5 pro output token are token except if you are using structure output, then all character are count as a token each for billing.

- ...

Having the price per token is nice, but what is really needed is to know how much a given query / answer will cost you, as not all token are equals.

Re:Up to date prices for LLM APIs all in one place by alexellman on Friday July 25, 2025 @10:10AM (#44683324)
yeah I am going to add an experiment that runs everyday and the cost of that will be a column on the table. It will be something like summarize this article in 200 words and every model gets the same prompt + article
Re:Up to date prices for LLM APIs all in one place by bigiain on Friday July 25, 2025 @10:11PM (#44690704)
For me, and I suspect a lot of other HN readers, a comparison/benchmark on a coding task would be more useful. Something small enough that you can affordably run it every day across a reasonable range of coding focused models, but non trivial enough to be representative of day to day AI assisted coding.

One other idea - for people spending $20 or $200/month for AI coding tools, a monitoring service that tracks and alerts on detected pricing changes could be something worth paying for. I'd definitely subscribe at $5/month for something like that, and I'd consider paying more, possibly even talking work into paying $20 or $30 per month.

Re:Up to date prices for LLM APIs all in one place by BonoboIO on Friday July 25, 2025 @09:48AM (#44683090)
On gemini 2.5 pro output token are token except if you are using structure output, then all character are count as a token each for billing.

Can you elaborate this? I don’t quite understand the difference.

Re:Up to date prices for LLM APIs all in one place by rsanek on Friday July 25, 2025 @06:52PM (#44689441)
I hadn't heard of this before either and can't find anything to support it on the pricing page.

https://ai.google.dev/gemini-api/docs/tokens