Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by ascorbic on Saturday August 16, 2025 @02:40AM
(#44920816)
Right, but RLHF is mostly reinforcing answers that people prefer. Even if you don't believe sentience is possible, it shouldn't be a stretch to believe that sentience might produce answers that people prefer. In that case it wouldn't need to be an explicit goal.
[ Parent
| on HN ]
Re:Claude Opus 4 and 4.1 can now end a rare subset of conver...
by root_axis on Saturday August 16, 2025 @08:38AM
(#44922789)
>it shouldn't be a stretch to believe that sentience might produce answers that people prefer
Even if that were true, there's no reason to believe that training LLMs to produce answers people prefer leads it towards sentience.