This is true of pretty much all of machine learning. LLMs are just getting singled out because their outputs are not getting the same level of validation that typicall occurs with older approaches. BERT models will also spit out whacky stuff, depending on how they’re trained/fine-tuned/used/etc
Additional layers of these 'LLMs' could read the responses and determine whether their premises are valid and their logic is sound as necessary to support the presented conclusion(s), and then just suggest a different citation URL for the preceding text.
"#StructuredPremises"
edit: I don't like your linked article at all. Subtly misleading and/or misinformed. Like a yahoo news but for ML.
to clarify: No one (certainly not OpenAI) ever suggested that RLHF was even remotely useful at dealing with the problem of hallucinations. It's not for that. The insinuation that it was designed for that purpose (at least partially) and yet _failed_ is a faulty one. It was not designed for that purpose. Hallucinations are a known issue with large language models, and while I appreciate LeCunn re-iterating that; far lesser researchers than LeCunn are aware of that fact.
https://www.hopsworks.ai/dictionary/rlhf-reinforcement-learn...