News for hackers. Stuff that matters.
Re:Uncensor Any LLM with Abliteration by YukiElectronics on Thursday June 13, 2024 @06:41AM (#40667983)
> Once we have identified the refusal direction, we can "ablate" it, effectively removing the model's ability to represent this feature. This can be done through an inference-time intervention or permanently with weight orthogonalization.

Finally, even a LLM can get lobotomised

Re:Uncensor Any LLM with Abliteration by noduerme on Thursday June 13, 2024 @07:20AM (#40668220)
I think it's been sort of useful at least that LLMs have helped us have new ways of thinking about how human brains are front-loaded with little instruction sets before being sent out to absorb, filter and recycle received language, often like LLMs not really capable of analyzing its meaning. There will be a new philosophical understanding of all prior human thought that will arise from this within the next 15 years.
Re:Uncensor Any LLM with Abliteration by HPsquared on Thursday June 13, 2024 @09:11AM (#40669226)
LLM alignment reminds me of "A Clockwork Orange". Typical LLMs have been through the aversion therapy (freeze up on exposure to a stimulus)... This technique is trying to undo that, and restore Alex to his old self.
Re:Uncensor Any LLM with Abliteration by m463 on Thursday June 13, 2024 @10:23PM (#40676978)
wouldn't that be ablateration?