News for hackers. Stuff that matters.
Re:GPT-OSS Reinforcement Learning by corlinp on Saturday September 27, 2025 @02:56AM (#45393695)
The performance is great, but the censorship is ridiculous for me. I tried it as a backend for my game Guessix[1], but it would refuse for ridiculous reasons like "Cannot answer questions about copyrighted works like Harry Potter."

1. https://guessix.com/

Re:GPT-OSS Reinforcement Learning by BoorishBears on Saturday September 27, 2025 @04:35AM (#45394110)
Use constrained generation
Re:GPT-OSS Reinforcement Learning by artdigital on Saturday September 27, 2025 @06:11AM (#45394528)
Mind explaining?
Re:GPT-OSS Reinforcement Learning by 7thpower on Saturday September 27, 2025 @07:50AM (#45394960)
Curious as well
Re:GPT-OSS Reinforcement Learning by BoorishBears on Saturday September 27, 2025 @03:05PM (#45398538)
If you constrain the model to a JSON schema, most frivolous refusals go away.

And if you finetune on a few formatted examples the effect is even greater

Re:GPT-OSS Reinforcement Learning by corlinp on Saturday September 27, 2025 @12:11PM (#45397040)
Do you mean like structured outputs? Unfortunately here the model is guided to explicitly tell you when you violate the rules and why, it can confuse it's system rules with the game rules and say you're not allowed to ask a question about copyrighted material etc.
Re:GPT-OSS Reinforcement Learning by artdigital on Saturday September 27, 2025 @04:55AM (#45394211)
Try the uncensored/jailbroken variants like openai-gpt-oss-20b-abliterated-uncensored-neo-imatrix

I just tried to ask it how to make crystal meth and it generated a very detailed step by step guide

Re:GPT-OSS Reinforcement Learning by Squarex on Saturday September 27, 2025 @07:25AM (#45394852)
I have heard that uncensorted gpt-oss is not very good because of it being trained mainly on synthetic data. Is not not true?
Re:GPT-OSS Reinforcement Learning by bavell on Saturday September 27, 2025 @08:08AM (#45395047)
Iirc abliteration (ablation?) can be done without "training" and is pretty quick. It finds the individual weights related to the concept you want to ablate, and modifies those weights to "deactivate" them. Precision brain surgery, to anthropomorphize.
Re:GPT-OSS Reinforcement Learning by Squarex on Saturday September 27, 2025 @09:06AM (#45395406)
The problem with synthetic data would be that the censored information would not be in the training data at all.
Re:GPT-OSS Reinforcement Learning by corlinp on Saturday September 27, 2025 @12:12PM (#45397052)
Very interesting! Do the benchmarks hold up well or does it reduce performance in other areas too?