News for hackers. Stuff that matters.
Re:Llama and ChatGPT Are Not Open-Source by threeseed on Thursday July 27, 2023 @06:23PM (#36900945)
> reducing bias in the models is a noble goal

It's also a necessary goal in order for these models to be more broadly adopted.

We've seen too many examples of bias in the training data set manifesting in ways that actively discriminate against people. Which is unethical and in many places illegal.

And having copyrighted material and sexual content in your model will simply open you up to lawsuits as is happening right now between authors and OpenAI. Not sure that is a position most startups want to be in.

Re:Llama and ChatGPT Are Not Open-Source by version_five on Thursday July 27, 2023 @06:38PM (#36901070)
Nah, these are foundation models. Companies want to be able to put in guard rails that are applicable to their application, not start with a model lobotomized according to US tech company values. The censorship is about telling people how to think, like it always is, not for the good of the people using the models.
Re:Llama and ChatGPT Are Not Open-Source by bick_nyers on Thursday July 27, 2023 @06:46PM (#36901125)
Yup. Advance the foundation models as far as possible to create a representation of the internet/human experience and place safeguards on top.

Don't want your LLM to be used to create erotic fanfiction? Instead of gutting the LLM, just put a detector on the query and answers feeding into the LLM. Thankfully, with a non-neutered model you have access to a tool than can be used to perform such detection...

Re:Llama and ChatGPT Are Not Open-Source by pkdpic on Thursday July 27, 2023 @07:27PM (#36901433)
Or tell another instance of the model to act as a constitutional-driven censor and let them duke it out.
Re:Llama and ChatGPT Are Not Open-Source by bick_nyers on Thursday July 27, 2023 @07:32PM (#36901476)
Now that's a fanfic I would read!
Re:Llama and ChatGPT Are Not Open-Source by threeseed on Thursday July 27, 2023 @06:48PM (#36901154)
> US tech company values

Which do broadly align with the values across most of the world.

But if you want to build something that has different values then go ahead.

But you can't expect companies to be complicit in doing something which is unethical or illegal.

Re:Llama and ChatGPT Are Not Open-Source by goatlover on Thursday July 27, 2023 @07:20PM (#36901378)
> Which do broadly align with the values across most of the world.

Satire?

Re:Llama and ChatGPT Are Not Open-Source by version_five on Thursday July 27, 2023 @07:22PM (#36901400)
Colonialism
Re:Llama and ChatGPT Are Not Open-Source by bick_nyers on Thursday July 27, 2023 @06:37PM (#36901064)
College students don't want to be criminally charged with theft for pirating an $800 college textbook either. I'm not giving business advice, I'm giving humanity and knowledge propagation advice.

As I mentioned, reducing bias is good so long as it doesn't introduce more bias elsewhere. The ultimate goal of course being a 100% bias free model.