Re:Training and Aligning LLMs with RLHF and RLHF Alternatives
by phillipcarter on Sunday September 10, 2023 @04:19PM
(#37459628)
Moreover, it's all about use case. If you need a high degree of reliability and reproducibility, don't use LLMs! Not yet, at least. That's fine though, because there's a ton of value they offer in solving problems where that isn't needed.
[ Parent
| on HN ]
Re:Training and Aligning LLMs with RLHF and RLHF Alternatives
by bugglebeetle on Sunday September 10, 2023 @04:50PM
(#37459944)
> If you need a high degree of reliability and reproducibility, don't use LLMs!
This is true of pretty much all of machine learning. LLMs are just getting singled out because their outputs are not getting the same level of validation that typicall occurs with older approaches. BERT models will also spit out whacky stuff, depending on how they’re trained/fine-tuned/used/etc