Air Canada ordered to pay customer who was misled by airline's chatbot

Re:Air Canada ordered to pay customer who was misled by airl... by jerpint on Friday February 16, 2024 @08:41PM (#39405469)

There are no guarantees with RAG either, and RAG only works when the answer to the question is already printed out somewhere explicitly in the text, otherwise it’s definitely prone to hallucinate

[ Parent | on HN ]

Re:Air Canada ordered to pay customer who was misled by airl... by alexxys on Friday February 16, 2024 @09:17PM (#39405680)

Yeah, RAG can't provide such guarantees. Moreover, even if the correct answer is printed somewhere, LLM+RAG still may produce wrong answer. Example from MS Copilot with GPT-4: https://sl.bing.net/ct6wwRjzkPc It claims that OnePlus 6 has 6.4-inch display, but all linked pages actually claim that it's 6.28. Display resolution and aspect ratio are also wrong in the response.

[ Parent | on HN ]

Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @11:07PM (#39406274)

It's funny it seems to have a lot of trouble extracting tabular data, which arguably is one of the things I hear people trying to do with it..

[ Parent | on HN ]