News for hackers. Stuff that matters.
Re:Llama 3.1 Official Launch by listic on Tuesday July 23, 2024 @08:54PM (#41052627)
Just checked it out. Is pay-as-you-go API access available at all? It says 'Coming Soon'

https://console.groq.com/settings/billing

Re:Llama 3.1 Official Launch by Alifatisk on Wednesday July 24, 2024 @04:40AM (#41054887)
I think you answered it yourself? It’s coming soon, so it is not available now, but soon.
Re:Llama 3.1 Official Launch by senko on Wednesday July 24, 2024 @08:06AM (#41056099)
It's been coming soon for a couple of months now, meanwhile Groq churns out a lot of other improvements, so to an outsider like me it looks like it's not terribly high on their list of priorities.

I'm really impressed by what (&how) they're doing and would like to pay for a higher rate limit, or failing that at least know if "soon" means "weeks" or "months" or "eventually".

I remember TravisCI did something similar back in the day, and then Circle and GitHub ate their lunch.

Re:Llama 3.1 Official Launch by weberer on Wednesday July 24, 2024 @05:32AM (#41055198)
I've found Bedrock to be nice with pay-as-you-go, but they take a long time to adopt new models.
Re:Llama 3.1 Official Launch by d13 on Wednesday July 24, 2024 @08:19AM (#41056220)
And twice as expensive in comparison to the source providers’ APIs