Re:"As a Language Model": Chat Template Switches LLM Self-Re...
by StilesCrisis on Sunday September 27, 2026 @09:52AM
(#49866655)
I feel like in real life, we're constantly exposed to "I don't know" as a valid answer, but obviously we don't write down all the I-don't-knows in expert literature so the training corpus is wildly skewed towards confident answers because "we studied this for a month and have no idea, it's confusing" doesn't get published.
[ Parent
| on HN ]
Re:"As a Language Model": Chat Template Switches LLM Self-Re...
by daveguy on Sunday September 27, 2026 @11:53AM
(#49867813)
That's a great point. A training corpus based on written text will be inherently biased toward confident and right. Then the RLHF exacerbates the problem because people respond more positively to confident and too often assume correct when they read a confident response.