Re:If you give Copilot the reins, don't be surprised when it...
by visarga on Friday August 09, 2024 @06:45AM
(#41200560)
> Now to control this you want a capability to precisely define the allowed and dis allowed behaviour.
I don't think regular software controls are flexible enough but there is research in making AI create its own "RLHF" fine-tuning dataset, like Constitutional AI from Anthropic. You only need to give it a few general guidelines and let it figure out the details. Never heard anyone complain Claude is unsafe or a bad chat experience.
I don't think regular software controls are flexible enough but there is research in making AI create its own "RLHF" fine-tuning dataset, like Constitutional AI from Anthropic. You only need to give it a few general guidelines and let it figure out the details. Never heard anyone complain Claude is unsafe or a bad chat experience.