News for hackers. Stuff that matters.
Re:Meta Llama 3 by int_19h on Thursday April 18, 2024 @07:38PM (#40081871)
"Censored" is the word that you're looking for, and is generally what you see when these models are discussed on Reddit etc.

Not to worry - uncensored finetunes will be coming shortly.

Re:Meta Llama 3 by weebull on Friday April 19, 2024 @05:35AM (#40084803)
You can't really take out the censorship. You can strengthen pathways which work around the damage, but the damage is still there.
Re:Meta Llama 3 by int_19h on Saturday April 20, 2024 @03:56AM (#40095619)
If the model doesn't refuse to produce output, it's not censored anymore for any practical purpose. It doesn't really matter if there are "censorship neurons" inside that are routed around.

Sure, it would be nice if we didn't have to do that so that the model could actually spent its full capacity on something useful. But that's a different issue even if the root cause is the same.