News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by dwheeler on Saturday April 15, 2023 @06:23PM (#35585201)
> Thanks to the open-source efforts like LLaMA ...

Is the LLaMA model really open source now? Last I checked it was only licensed for non-commercial use, which isn't open source software at least. Have they changed the license? Are people depending on "databases can't be copyrighted"? Are people just presuming they won't be caught?

There's lots of OSS that can use LLaMA but that's different from the model itself.

This is a genuine question, people are making assertions but I can't find evidence for the assertions.

Re:Web LLM – WebGPU Powered Inference of Large Language Models by Anduia on Saturday April 15, 2023 @06:35PM (#35585315)
Not all implementations of it use the same license. See for example lit-llama by Lightning AI:

https://news.ycombinator.com/item?id=35344787

Re:Web LLM – WebGPU Powered Inference of Large Language Models by dwheeler on Saturday April 15, 2023 @08:33PM (#35586068)
That is for code to download the model, not for the model itself.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by jerpint on Sunday April 16, 2023 @07:11AM (#35588976)
They actually reimplemented the code to load the model. But it’s not clear if the weights of the model are free to use or not
Re:Web LLM – WebGPU Powered Inference of Large Language Models by Tepix on Sunday April 16, 2023 @02:50PM (#35593103)
What do you mean, it's not clear?

https://github.com/facebookresearch/llama links to

https://forms.gle/jk851eBVbX1m5TAv5 which contains LLaMA license agreement below the form.

Re:Web LLM – WebGPU Powered Inference of Large Language Models by dwheeler on Sunday April 16, 2023 @03:50PM (#35593666)
Ok, all evidence I can find is that the LLaMA model is not open source, and the article is just wrong. Software != model. If someone has evidence otherwise, please post.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by wokwokwok on Saturday April 15, 2023 @08:22PM (#35586006)
Most people are distributing diff files like this https://github.com/lm-sys/FastChat#vicuna-weights

Ie. Here’s a diff. Go find your own copy of the llama model and apply this patch.

…and hoping that’s good enough to get away with; even though you can’t really argue it’s not distributing a derivative work in part.

Distribution of the actual model (eg. Running it in your browser) seems to usually result in “and then Meta slaps you with a takedown notice”.

Re:Web LLM – WebGPU Powered Inference of Large Language Models by Tepix on Sunday April 16, 2023 @02:51PM (#35593111)
I've only seen vicuna do it so far but this is the right way for now.