I want to see a citation for this. And a clear definition for what is a hallucination and what isn't.
https://www.medpagetoday.com/ophthalmology/generalophthalmol....
- Survey of Hallucination in Natural Language Generation](https://arxiv.org/abs/2202.03629) (Ji et al., 2022)
- [How Language Model Hallucinations Can Snowball](https://arxiv.org/abs/2305.13534) (Zhang et al., 2023)
- [A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity](https://arxiv.org/abs/2302.04023) (Bang et al., 2023)
- [Contrastive Learning Reduces Hallucination in Conversations](https://arxiv.org/abs/2212.10400) (Sun et al., 2022)
- [Self-Consistency Improves Chain of Thought Reasoning in Language Models](https://arxiv.org/abs/2203.11171) (Wang et al., 2022)
- [SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models](https://arxiv.org/abs/2303.08896) ( Manakul et al., 2023)
I can’t have a tool that makes up stuff an unknown amount of time.
There is a world of research examining hallucination Rates, indicating hallucination rates of 30%+.
With steps to reduce it using RAGs, you could potentially improve the results significantly - last I checked it was 80-90%.
And the failure types aren’t just accuracy, it’s precision, recall, relevance and more.