News for hackers. Stuff that matters.

A comment on OpenAI: Start using ChatGPT instantly. Parent comment

Re:OpenAI: Start using ChatGPT instantly by BoorishBears on Monday April 01, 2024 @02:33PM (#39897477)
Great example: can't scale enough to remove their 30 requests per minute (!) rate limit and enable billing, barely meets 3.5 levels of intelligence, etc;

People don't seem to understand that scaling out LLMs efficiently is it's own art that OpenAI is probably learning lessons on faster than anyone else

[ Parent | on HN ]
Re:OpenAI: Start using ChatGPT instantly by kaibee on Monday April 01, 2024 @04:11PM (#39898606)
You're thinking of Grok. Not Groq. Blame Elon for this naming catastrophe.
[ Parent | on HN ]
Re:OpenAI: Start using ChatGPT instantly by BoorishBears on Monday April 01, 2024 @05:32PM (#39899627)
Lol what? No, I'm thinking of Groq.

I love Groq though, every time someone hypes up their project using it you instantly know they have no real usage whatsoever.

Even the most "toyish" toy project doesn't fit in their rate limits for anything more than personal use.

[ Parent | on HN ]