Re:Bing: “I will not harm you unless you harm me first”
by theptip on Wednesday February 15, 2023 @02:27PM
(#34809261)
The current state of the art is RLHF (reinforcement learning with human feedback); initially trained to complete human utterances, plus fine-tuning to maximize human feedback on whether the completion was "helpful" etc.
It is “aligned” to human utterances instead. We don’t want AIs to actually be human-like in that sense. Yet we train them with the entirety of human digital output.