News for hackers. Stuff that matters.
Re:Refusal in Language Models Is Mediated by a Single Direction by bastawhiz on Saturday May 02, 2026 @06:28PM (#47991230)
There are many abliterations which work quite well. Older techniques do suffer from quality issues, but more recent ones do a much better job. In particular, the older approaches did poorly on MoE models.

Another likely problem you're running into: the problems with older techniques compound with quantization. Anything less than 5-bit quant is going to give you some pretty sketchy outputs, in my experience.

There are no comments on this comment yet.