News for hackers. Stuff that matters.
Re:OpenAI is too cheap to beat by Turing_Machine on Thursday October 12, 2023 @06:50PM (#37864176)
I'd bet that there are any number of submarine startups out there sitting on top of full downloads of Common Crawl, archive.org, etc. who are only too happy to let OpenAI be the first penguin off the iceberg.

If OpenAI survives all the legal challenges, they'll just click "Go" and be in business in weeks to months.

If OpenAI gets smacked down, they haven't lost much.

There are probably also some submarine operations that are already doing/have done the training. If OpenAI gets bankrupted for copyright violations, we'll just never hear from those.

Re:OpenAI is too cheap to beat by p1esk on Thursday October 12, 2023 @07:04PM (#37864319)
You might be forgetting the cost to train a 1.8T model.
Re:OpenAI is too cheap to beat by lmm on Thursday October 12, 2023 @10:09PM (#37865734)
The cost is peanuts compared to the potential profit. Apple/Google/Facebook could absolutely eat the costs for a skunkworks project to do that training and just sit quietly waiting on the yes/no from legal.
Re:OpenAI is too cheap to beat by 0x008 on Friday October 13, 2023 @01:54AM (#37867204)
But the question is rather of the cost are peanuts compared to expected cash flow for the next 12 months.
Re:OpenAI is too cheap to beat by htrp on Friday October 13, 2023 @09:13AM (#37870206)
>submarine startups out there sitting on top of full downloads of Common Crawl, archive.org, etc. who are only too happy to let OpenAI be the first penguin off the iceberg.

Not sure any startup would be ok with sitting on a potentially gamechanging model.

Google/Facebook? Maybe?

Amazon's LLM efforts are pretty much in shambles