News for hackers. Stuff that matters.
Re:Heretic: Automatic censorship removal for language models by Vera_Wilde on Monday November 17, 2025 @01:45AM (#45951340)
The directional‐ablation approach in Heretic is clever: by identifying residual “refusal directions” and ablating them, they shift the trade-off frontier for the model. In rare‐event screening terms: they’re effectively changing the detection threshold geometry rather than trying just to get better data. It resonates with how improving a test’s accuracy in low-prevalence settings often fails unless you address threshold + base rate.
Re:Heretic: Automatic censorship removal for language models by xmcqdpt2 on Monday November 17, 2025 @09:11AM (#45953692)
The paper is great. It really shows how alignement is entirely surface level and not actually deeply ingrained in the models. Really interesting work.