News for hackers. Stuff that matters.

A comment on If you can't reproduce the model then it's not open-source. Parent comment

Re:If you can't reproduce the model then it's not open-source by tikhonj on Wednesday January 17, 2024 @03:47PM (#39033223)
The public doesn't have the resources to train the largest state-of-the-art LLMs, but training useful LLMs seems doable. Maybe not for most individuals but certainly for a range of nonprofits, research teams and companies.
[ Parent | on HN ]
Re:If you can't reproduce the model then it's not open-source by stcredzero on Wednesday January 17, 2024 @04:32PM (#39033799)
Isn't is relatively easy for a smaller model to poke holes in the output of a larger model?
[ Parent | on HN ]
Re:If you can't reproduce the model then it's not open-source by jncfhnb on Wednesday January 17, 2024 @05:14PM (#39034312)
But not nearly as in reach as modifying open source models.
[ Parent | on HN ]