News for hackers. Stuff that matters.
Re:Ilya Sutskever to leave OpenAI by threeseed on Tuesday May 14, 2024 @07:44PM (#40361437)
You will still need the compute resources of Microsoft, Meta etc.

And they have their own people who equally know how LLMs work.

Even raising funds is not a certainty given that VCs are becoming more cautious with AI as they realise it's now a platform fight between the mega corporations.

Re:Ilya Sutskever to leave OpenAI by zeroCalories on Tuesday May 14, 2024 @08:22PM (#40361673)
Plenty of companies have compute, but everyone is barely catching up to GPT-4 over a year after release. I'm sure places like Meta would love to unlock the details of what makes it so good.
Re:Ilya Sutskever to leave OpenAI by CuriouslyC on Tuesday May 14, 2024 @09:37PM (#40362165)
There's no mystery, they just have a lot of actual user data, so they've been able to refine the question answering behavior. They've also baked some common problem solving strategies like chain of thought into the model via training.
Re:Ilya Sutskever to leave OpenAI by vanjajaja1 on Tuesday May 14, 2024 @08:17PM (#40361647)
yep, and the puzzle isnt 'make chatgtp again' its 'catch up to chatgpt' which is a whole other puzzle
Re:Ilya Sutskever to leave OpenAI by ignoramous on Tuesday May 14, 2024 @09:14PM (#40362027)
> Even raising funds is not a certainty given that VCs are becoming more cautious

You'd think any investor would be utterly stupid to not make an exception for Ilya, regardless.

Re:Ilya Sutskever to leave OpenAI by callalex on Tuesday May 14, 2024 @09:21PM (#40362084)
That’s not such a given. There are a toooon of deep pockets in this space already and absolutely zero path to profitable products for any of them.