News for hackers. Stuff that matters.
Re:Llama and ChatGPT Are Not Open-Source by 1vuio0pswjnm7 on Thursday July 27, 2023 @07:23PM (#36901410)
"Mark Dingemanse, a coauthor of this report, had a particularly strong assessment of the Llama 2 model: "Meta using the term `open source' for this is positively misleading: There is no source to be seen, the training data is entirely undocumented, and beyond the glossy charts the technical documentation is really rather poor. We do not know why Meta is so intent on getting everyone into this model, but the history of this company's choices does not inspire confidence. Users beware.""
Re:Llama and ChatGPT Are Not Open-Source by aalimov_ on Thursday July 27, 2023 @09:39PM (#36902241)
Does anyone have an idea of what (if anything) is being implied by the last two sentences?
Re:Llama and ChatGPT Are Not Open-Source by smoldesu on Thursday July 27, 2023 @10:02PM (#36902396)
Bad company scary, I guess. Normally I'm sympathetic to those types, but given how Llama works without a network connection I'm not sure what I have to fear. The "history of this company's choices" has generally been pretty good with AI, so it sounds like speculation on their part.
Re:Llama and ChatGPT Are Not Open-Source by pedrosorio on Thursday July 27, 2023 @10:14PM (#36902474)
See my sibling comment. Very unlikely the author has any familiarity with Meta's history of releasing open source software for ML/AI.
Re:Llama and ChatGPT Are Not Open-Source by pedrosorio on Thursday July 27, 2023 @10:13PM (#36902462)
> He is an associate professor in Language and Communication at the Centre for Language Studies of Radboud University Nijmegen. Dingemanse obtained a MA degree in African Languages and Cultures at Leiden University in 2006, and a PhD degree in arts in 2011 at Radboud University Nijmegen

https://en.wikipedia.org/wiki/Mark_Dingemanse

This co-author? Given the relevance of their academic background, I'd take their opinion on "the dangers of using LLMs released by the untrustworthy Meta" with a grain of salt.

Re:Llama and ChatGPT Are Not Open-Source by reverius42 on Thursday July 27, 2023 @10:19PM (#36902496)
Since their academic background is so relevant (language studies and cultures being the exact domain of the impact of LLMs on society), I don't see why a grain of salt is needed.
Re:Llama and ChatGPT Are Not Open-Source by pedrosorio on Thursday July 27, 2023 @10:37PM (#36902603)
> Since their academic background is so relevant

If their academic background were relevant, they would have provided specific negative outcomes that may result from the usage of Llama 2, rather than a vague "the history of this company's choices does not inspire confidence".

What, of the many open source software releases by that company in the ML/AI field "does not inspire confidence"?

Re:Llama and ChatGPT Are Not Open-Source by hmcq6 on Friday July 28, 2023 @01:19AM (#36903327)
> What, of the many open source software releases by that company in the ML/AI field "does not inspire confidence"?

Didn't Facebook get it's start by Zucc populating it with his classmates without their knowledge or consent?

> Zuckerberg found himself brought before the Administrative Board for breaching security, violating copyrights and violating individuals’ privacy by using students’ online facebook photos without permission.

https://www.thecrimson.com/article/2004/6/10/mark-e-zuckerbe...

Re:Llama and ChatGPT Are Not Open-Source by 1vuio0pswjnm7 on Thursday July 27, 2023 @11:06PM (#36902727)
For more on what's beind the comment, see the following paper.

Title: Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators

Authors: Andreas Liesenfeld, Alianda Lopez, Mark Dingemanse

Abstract: Large language models that exhibit instruction-following behaviour represent one of the biggest recent upheavals in conversational interfaces, a trend in large part fuelled by the release of OpenAI's ChatGPT, a proprietary large language model for text generation fine-tuned through reinforcement learning from human feedback (LLM+RLHF). We review the risks of relying on proprietary software and survey the first crop of open-source projects of comparable architecture and functionality. The main contribution of this paper is to show that openness is differentiated, and to offer scientific documentation of degrees of openness in this fast-moving field. We evaluate projects in terms of openness of code, training data, model weights, RLHF data, licensing, scientific documentation, and access methods. We find that while there is a fast-growing list of projects billing themselves as 'open source', many inherit undocumented data of dubious legality, few share the all-important instruction-tuning (a key site where human annotation labour is involved), and careful scientific documentation is exceedingly rare. Degrees of openness are relevant to fairness and accountability at all points, from data collection and curation to model architecture, and from training and fine-tuning to release and deployment.

https://arxiv.org/abs/2307.05532

https://arxiv.org/pdf/2307.05532.pdf

Re:Llama and ChatGPT Are Not Open-Source by 1vuio0pswjnm7 on Thursday July 27, 2023 @11:10PM (#36902753)
It seems Dr Dingemanse understands the problems introduced by so-called "tech" companies, e.g., Google.

"For basic visitor statistics I use Matomo, an excellent open source alternative for Google Analytics. IP addresses are anonymized and data never leaves the server."

https://markdingemanse.net/credits

Re:Llama and ChatGPT Are Not Open-Source by uhhyeahdude on Friday July 28, 2023 @04:38AM (#36904330)
You know, this site has been going through something lately. I really don’t understand this kind of comment. Is google not a tech company? Are you being sarcastic? No? What are you trying to convey here other than empty signaling? WTF do you mean, actually?

Author uses non-google analytics software on web site. Is that significant or unexpected given the context?

How does any of this support your first sentence?

Am I just old? Are you an LLM? Did I just get trolled by a chat bot? All of these?