News for hackers. Stuff that matters.
Re:Training and Aligning LLMs with RLHF and RLHF Alternatives by phillipcarter on Sunday September 10, 2023 @04:19PM (#37459628)
Moreover, it's all about use case. If you need a high degree of reliability and reproducibility, don't use LLMs! Not yet, at least. That's fine though, because there's a ton of value they offer in solving problems where that isn't needed.
Re:Training and Aligning LLMs with RLHF and RLHF Alternatives by bugglebeetle on Sunday September 10, 2023 @04:50PM (#37459944)
> If you need a high degree of reliability and reproducibility, don't use LLMs!

This is true of pretty much all of machine learning. LLMs are just getting singled out because their outputs are not getting the same level of validation that typicall occurs with older approaches. BERT models will also spit out whacky stuff, depending on how they’re trained/fine-tuned/used/etc

Re:Training and Aligning LLMs with RLHF and RLHF Alternatives by 3abiton on Sunday September 10, 2023 @05:04PM (#37460073)
I wonder if there will be a new metric implemented in evaluating LLMs: Hallucination score.