News for hackers. Stuff that matters.
Re:OpenAI's open language model is imminent by Legend2440 on Wednesday July 09, 2025 @02:05PM (#44513104)
'open source' isn't even a meaningful word for LLMs, since they don't have source code in the traditional sense.
Re:OpenAI's open language model is imminent by vrighter on Wednesday July 09, 2025 @02:09PM (#44513152)
yes they do. training code, dataset, and random seed. given all three, you can recreate the final model (the weights). The set of all three is the source code
Re:OpenAI's open language model is imminent by lavoiems on Wednesday July 09, 2025 @02:17PM (#44513216)
That and random race conditions occurring during training.
Re:OpenAI's open language model is imminent by herbst on Wednesday July 09, 2025 @02:15PM (#44513188)
If I could theoretically fully rebuild it based on the given data I would call it open source. See the upcoming ETH model, it should be completely reproduceable