News for hackers. Stuff that matters.
Re:Hi everyone yes, I left OpenAI yesterday by roody15 on Wednesday February 14, 2024 @12:19AM (#39366773)
Yeah but for how long… at this rate I would expect some of the freely distributed models to hit gpt4 levels in as little as 3-6 months.
Re:Hi everyone yes, I left OpenAI yesterday by int_19h on Wednesday February 14, 2024 @01:58AM (#39367251)
I've heard claims like that 6 months ago.

But so far nobody is even in the same ballpark. And not just freely distributed models, but proprietary ones backed by big money, as well.

It really makes one wonder what kind of secret sauce OpenAI has. Surely it can't just be all that compute that Microsoft bought them, since Google could easily match that, and yet...

Re:Hi everyone yes, I left OpenAI yesterday by qeternity on Wednesday February 14, 2024 @09:42AM (#39370289)
> But so far nobody is even in the same ballpark.

Miqu is pretty good. Sure, it's a leak...but there's nothing special there. It's just a 70b llama2 finetune.

Re:Hi everyone yes, I left OpenAI yesterday by int_19h on Wednesday February 14, 2024 @05:06PM (#39376228)
By the standards of other llama2 finetunes, sure. Compared to GPT-4, I stand by my previous assertion.
Re:Hi everyone yes, I left OpenAI yesterday by huytersd on Wednesday February 14, 2024 @05:21PM (#39376390)
Order of magnitude means they’re going to take 20 times longer to get to the 4. So maybe on the order of 40-60 months from this point.