News for hackers. Stuff that matters.
Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM by mattpavelle on Monday August 11, 2025 @08:56AM (#44863595)
Yes but the abliterated versions (those with partially removed guardrails) are significantly “dumber” so the trade off isn’t worthwhile imho.
Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM by hnuser123456 on Monday August 11, 2025 @07:54PM (#44870822)
Research also often finds that fine-tuning in more guardrails also decreases performance, which is done to all non-base instruction tuned models, which most people are using.