News for hackers. Stuff that matters.
Re:RedPajama: Reproduction of Llama with Friendly License (S... by quickthrower2 on Monday April 17, 2023 @06:37PM (#35607589)
As I understand it they have the input data, but next up they are creating the model. I could make a joke about drawing an owl ... but that would be a bit mean. I am really glad people are working on this.

I wonder... who is paying? Will there be restrictions like ethics clauses and suchlike. Not necessarily a bad thing if they do. Will there be restrictions on commercial use.

Re:RedPajama: Reproduction of Llama with Friendly License (S... by jamiedg on Monday April 17, 2023 @08:16PM (#35608392)
Hi! I lead Product at Together. We will be releasing a full suite of models trained on this data starting with the first models in the coming weeks. We will release base models and instruction-tuned models. All of the models will be released under the Apache 2.0 license, allowing commercial use.
Re:RedPajama: Reproduction of Llama with Friendly License (S... by quickthrower2 on Monday April 17, 2023 @09:52PM (#35609051)
Thanks, that is exciting! Given these LLMs seem to cost $millions (or hundreds of thousands) to train, how is this funded. Is it a government / research funded thing, or VC, or philanthropy for example?