News for hackers. Stuff that matters.

A comment on Show HN: I Created ErisForge, a Python Library for Abliteration of LLMs.

Re:Show HN: I Created ErisForge, a Python Library for Ablite... by deadbabe on Monday January 27, 2025 @02:51PM (#42844919)
I don’t get the point of abliteration of LLMs. You’re lobotomizing the model and it will result in worse performance.

If you’re doing it to get past refusals you might discover the LLM wasn’t even trained much on refusable content so it will output poor results.

We’ll look back on this practice and shake our heads someday.

[ Parent | on HN ]
Re:Show HN: I Created ErisForge, a Python Library for Ablite... by tsadoq on Monday January 27, 2025 @03:02PM (#42845010)
Not necessarily true, one quick pass might be needed but quite not as devastating as it might seem

https://huggingface.co/blog/mlabonne/abliteration#%E2%9A%96%...

[ Parent | on HN ]