News for hackers. Stuff that matters.
Re:Hello Dolly: Democratizing the magic of ChatGPT with open... by amrb on Friday March 24, 2023 @12:29PM (#35291479)
Are they pulling a Facebook, on model access?
Re:Hello Dolly: Democratizing the magic of ChatGPT with open... by dragonwriter on Friday March 24, 2023 @01:16PM (#35292288)
I think they are dodging unclear legal issues surrounding certain steps of the model-building process while being as open as possible with the components given that constraint, allowing downstream users to make their own legal risk vs. effort choices.
Re:Hello Dolly: Democratizing the magic of ChatGPT with open... by amrb on Friday March 24, 2023 @02:04PM (#35293145)
Given the hardware/energy need to train it be nice, to have a legal document that said something like this model has no warranty, it may be a break through machine or a hand grenade. Use at you own risk!
Re:Hello Dolly: Democratizing the magic of ChatGPT with open... by pwendell on Friday March 24, 2023 @04:00PM (#35294624)
Yes, this.
Re:Hello Dolly: Democratizing the magic of ChatGPT with open... by thewataccount on Friday March 24, 2023 @01:27PM (#35292491)
From what I can tell they're fine-tuning EleutherAI's GPT-J.

Alpaca was made to fine-tune LLaMa, however they also released their dataset they used to do this, and it looks like Dolly is this dataset applied to GPT-J, and does not use LLaMa itself.