News for hackers. Stuff that matters.
Re:LLM pricing comparison tool – [free] by Lalabadie on Sunday March 24, 2024 @08:33AM (#39806823)
The numerical sorting on the page goes 0.25, 0.15, 0.13, 0.8. This is a friendly reminder that in JS the sort() function should always be given a comparator function.
Re:LLM pricing comparison tool – [free] by croemer on Sunday March 24, 2024 @08:23AM (#39806783)
Don't editorialize titles: free is unnecessary in the heading.
Re:LLM pricing comparison tool – [free] by starfox64_ on Sunday March 24, 2024 @08:20AM (#39806769)
Sorting by price doesn't seem to work as it sorts alphabetically
Re:LLM pricing comparison tool – [free] by alexbruner on Sunday March 24, 2024 @12:20PM (#39808124)
Thank you all for being such an amazing community. The sorting issue many of you reported and helped diagnose has now been fixed!
Re:LLM pricing comparison tool – [free] by freeqaz on Sunday March 24, 2024 @08:09AM (#39806699)
Dang, so is Groq the cheapest for running Mixtral then? How capable is that model versus GPT 3.5 for basic tasks?
Re:LLM pricing comparison tool – [free] by ilaksh on Sunday March 24, 2024 @08:13AM (#39806728)
It's not too far behind. But Groq is currently not billing and I think it's because they haven't finished programming their billing system. So with such a fast service being free, there is a lot of queueing and presently is unusable because of random response times. Once it finally processes the request it's quite fast but there is a line.

So I am going with Claude 3 Haiku. Hopefully Groq will be able to start charging soon and the load will be more tolerable to service without queues.

Re:LLM pricing comparison tool – [free] by jstummbillig on Sunday March 24, 2024 @08:24AM (#39806787)
Is there a production case you are using Haiku for? If so, can you outline it?
Re:LLM pricing comparison tool – [free] by 0x008 on Monday March 25, 2024 @08:00AM (#39815198)
The tool is cool, but very US-centric. There is no possibility to select the Azure Datacenter.. I think pricing is different from NA to EU, if I am not mistaken.