Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM
by mattpavelle on Monday August 11, 2025 @08:56AM
(#44863595)
Yes but the abliterated versions (those with partially removed guardrails) are significantly “dumber” so the trade off isn’t worthwhile imho.
[ Parent
| on HN ]
Re:GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM
by hnuser123456 on Monday August 11, 2025 @07:54PM
(#44870822)
Research also often finds that fine-tuning in more guardrails also decreases performance, which is done to all non-base instruction tuned models, which most people are using.