News for hackers. Stuff that matters.
Re:If you give Copilot the reins, don't be surprised when it... by visarga on Friday August 09, 2024 @06:45AM (#41200560)
> Now to control this you want a capability to precisely define the allowed and dis allowed behaviour.

I don't think regular software controls are flexible enough but there is research in making AI create its own "RLHF" fine-tuning dataset, like Constitutional AI from Anthropic. You only need to give it a few general guidelines and let it figure out the details. Never heard anyone complain Claude is unsafe or a bad chat experience.

There are no comments on this comment yet.