Fast (suited for agents) and generous free tier (14k req/day for 70B models) would be my guess.

Much better explained than my own comment xD

They offer a lot of top LLMs for free. That's the reason why. I mean, I'm using llama3.1 fine tuned for tools completely free. That's the reasoning behind haha But you could choose any other. At first I was thinking about Ollama, but Groq came as a great choice.

Not going to lie, I definitely confused Groq for Grok here.

Yep, Groq™ even called out Grok for this: https://groq.com/hey-elon-its-time-to-cease-de-grok/

If you're going to lock your POC into an abusive API partnership with a for-profit AI organization, you might as well do it in a Cadillac I guess.

I'm using Groq, not Grok xD

CyberTruck*

Apparently Elon's AI is "Grok" not "Groq"

However, both are pseudointellectual names that implicate the owners as insecure nerds desperate for greater approval.

Aren’t they a reference to Heinlein? Seems “grok” is on point for what it does.

That's from Groq documentation:

"In fact, our name comes from the word “grok” which means the ability “to understand profoundly and intuitively.”"

hahahha wow, that's hard: "pseudointellectual names". I mean, didn't reflect about the naming. Just the fact that it offered a lot of LLMs for free xD