News for hackers. Stuff that matters.
Re:Show HN: Token price calculator for 400+ LLMs by qeternity on Monday June 17, 2024 @05:16PM (#40711163)
$/million tokens is the standard pricing metric.
Re:Show HN: Token price calculator for 400+ LLMs by Tao3300 on Monday June 17, 2024 @09:13PM (#40713082)
standard ≠ good
Re:Show HN: Token price calculator for 400+ LLMs by andenacitelli on Monday June 17, 2024 @11:25PM (#40713795)
Yes, but it’s true in the general case. Defaults are usually the defaults for a reason — someone putting thought into what makes sense for most users.
Re:Show HN: Token price calculator for 400+ LLMs by Tao3300 on Monday June 17, 2024 @11:29PM (#40713808)
Not necessarily so when you're trying to sell stuff...
Re:Show HN: Token price calculator for 400+ LLMs by ynniv on Tuesday June 18, 2024 @08:58AM (#40717296)
"Standard" doesn't imply "good", but that doesn't mean "non-standard" is better. Cost-per-quantity (L/100km) is easier to compare than quantity-per-cost (MPG) because how much you use isn't going to change based on the model. Which is to say, if two local models are both $0.00 per million tokens, they effectively have the same cost. You could argue that you might get better results by throwing out more tokens, but the solution is to add more significant digits to the price per unit.