Re:LLM pricing comparison tool – [free]
by freeqaz on Sunday March 24, 2024 @08:09AM
(#39806699)
Dang, so is Groq the cheapest for running Mixtral then? How capable is that model versus GPT 3.5 for basic tasks?
[ Parent
| on HN ]
It's not too far behind. But Groq is currently not billing and I think it's because they haven't finished programming their billing system. So with such a fast service being free, there is a lot of queueing and presently is unusable because of random response times. Once it finally processes the request it's quite fast but there is a line.
So I am going with Claude 3 Haiku. Hopefully Groq will be able to start charging soon and the load will be more tolerable to service without queues.
Re:LLM pricing comparison tool – [free]
by jstummbillig on Sunday March 24, 2024 @08:24AM
(#39806787)
Is there a production case you are using Haiku for? If so, can you outline it?