News for hackers. Stuff that matters.
Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @07:57PM (#39405151)
Yes, I think people underestimate the amount of imagined LLM use cases that require accurate responses. To the point that hallucinations will cost money in fines & lawsuits.

This is a new frontier in short sighted customer service staffing (non-staffing in this case). The people who are on the frontline communicating with customers can convert unhappy customers to repeat customers, or into ex-customers. There's a few brands I won't buy from again after having to jump through too many hoops to get (bad) warranty service.

Re:Air Canada ordered to pay customer who was misled by airl... by citizenpaul on Friday February 16, 2024 @08:38PM (#39405447)
>that hallucinations will cost money in fines & lawsuits.

Sure. They are now out about $600. They probably already laid off 500+ customer service jobs costing conservatively 30k a year each. Not including mgmt,training,health,ect. I don't think it will make a difference to the ivory tower C levels. We will just all get used to a once again lower quality help/product. Another great "enshitification" wave of the future with "AI"

It also assumes that the customer service people dont make mistakes at a similar level anyway.

Another "new normal" How come anything that is "new normal" is never good?

Re:Air Canada ordered to pay customer who was misled by airl... by eru on Friday February 16, 2024 @09:31PM (#39405768)
> Another "new normal" How come anything that is "new normal" is never good?

If it allows them to reduce costs (and there's enough competition to force them to pass that on as reduced prices), I'm fairly happy with a new normal.

See also how air travel in general used to be a lot more glamorous, but also a lot more expensive.

Re:Air Canada ordered to pay customer who was misled by airl... by lamontcg on Saturday February 17, 2024 @02:26AM (#39407229)
> and there's enough competition to force them to pass that on as reduced prices

i found the bug.

Re:Air Canada ordered to pay customer who was misled by airl... by eru on Saturday February 17, 2024 @07:50AM (#39408986)
Cynicism aside, air travel is one of the industries with pretty healthy levels of competition. (At least in Europe and South East Asia. I haven't spent much time in North America, so can't judge the market there.)

People love to hate eg RyanAir, but their effect on prices is felt throughout the industry; even if you never take a single RyanAir flight.

Re:Air Canada ordered to pay customer who was misled by airl... by citizenpaul on Saturday February 17, 2024 @09:42PM (#39415626)
Yeah they pass those cost saving right onto record corporate profits for the last 20 years...
Re:Air Canada ordered to pay customer who was misled by airl... by eru on Sunday February 18, 2024 @11:15PM (#39426174)
Huh? Airlines are notorious for being bad for investors.

(And even without looking up any data, I find your 'record profits for the last 20 years' hard to square with my memories of covid.)

EDIT: I tried to find some indices for airlines. The closest I found was https://finance.yahoo.com/quote/JETS/performance/ which didn't exactly have a stellar performance.

So I'm not sure where you get your claim from?

Re:Air Canada ordered to pay customer who was misled by airl... by citizenpaul on Thursday February 22, 2024 @12:16AM (#39463502)
I wasn't referring to airlines specifically. I see how I was unclear now. We are in a decade+ era of record corporate profits yet incomes are stagnate and costs are rising.

Airlines are weird. I think warren buffet said something about airlines being the most complicated way to guarantee losing money as a business or something like that once.

Re:Air Canada ordered to pay customer who was misled by airl... by atoav on Friday February 16, 2024 @09:39PM (#39405806)
Depends how long it takes to get the 600$ and whether you need to be a customer to get it. I know many people who would happily ask for that money once a week.
Re:Air Canada ordered to pay customer who was misled by airl... by TechSquidTV on Friday February 16, 2024 @08:27PM (#39405392)
With RAG it's entirely possible to essentially eliminate 100% of hallucinations, given you are ok with responding with "I don't know" once in a while. These situations are likely coming from poorly implemented chatbot, or they decided that "I dont know" was not acceptable, and really that should be a queue to send you to a real human.
Re:Air Canada ordered to pay customer who was misled by airl... by sebastiennight on Friday February 16, 2024 @09:00PM (#39405584)
This claim seems wildly inaccurate, as even with GPT-4 in a single conversation thread with previous human-written answers included, a repeat of a similar question just resulted - in my testing today - in a completely hallucinated answer.

I think your claim might be based on anecdotal testing. (I used to have that same feeling after my first implementation of RAG)... Once you get a few thousand users running RAG-based conversations, you quickly see that it's "good enough to be useful", but far from being as dreamy as promised.

Re:Air Canada ordered to pay customer who was misled by airl... by jerpint on Friday February 16, 2024 @08:41PM (#39405469)
There are no guarantees with RAG either, and RAG only works when the answer to the question is already printed out somewhere explicitly in the text, otherwise it’s definitely prone to hallucinate
Re:Air Canada ordered to pay customer who was misled by airl... by alexxys on Friday February 16, 2024 @09:17PM (#39405680)
Yeah, RAG can't provide such guarantees. Moreover, even if the correct answer is printed somewhere, LLM+RAG still may produce wrong answer. Example from MS Copilot with GPT-4: https://sl.bing.net/ct6wwRjzkPc It claims that OnePlus 6 has 6.4-inch display, but all linked pages actually claim that it's 6.28. Display resolution and aspect ratio are also wrong in the response.
Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @11:07PM (#39406274)
It's funny it seems to have a lot of trouble extracting tabular data, which arguably is one of the things I hear people trying to do with it..
Re:Air Canada ordered to pay customer who was misled by airl... by fivre on Friday February 16, 2024 @09:55PM (#39405895)
do the people managing the chatbot know that though?

this shit gets sold as a way to replace employees with, essentially, just the middle manager that was over them, who is now responsible for managing the chatbot instead of managing people

while managers are often actually not great at people management, it's at least a somewhat intuitive skill for many. interacting with and directing other humans is something that many people are able to gain experience with outside of work, since it's a necessary life skill unless you're a hermit. furthermore, as a hedge against managerial ineptitude, humans are adaptable creatures that can recognize their manager's shortcomings and determine when and how to work around them to actually get the job done

understanding the intricacies training a machine learning system is a highly specialized and technical skill that nobody is going to pick up base knowledge for in the regular course of life. the skill floor for the average person tasked with it will be much lower than that of people management, and they will probably fuck up, a lot

the onus is ostensibly on AI system vendors to make their systems idiot-proof, but how many vendors actually do so past the point of "looks good enough to close the sale in a demo"? designing such a system is _incredibly_ hard, and the unfortunate reality is that if you try, you'll lose sales to snake oil salesmen who are content to push hokum trash with a fancy coat of paint.

these systems can work as a force multiplier in the hands of the capable, but work as an incompetence magnifier in the hands of the incapable, and there are plenty of dunning-krugerites lusting to magnify their incompetence

Re:Air Canada ordered to pay customer who was misled by airl... by Piskvorrr on Wednesday February 21, 2024 @12:00PM (#39456347)
Well if incompetence is cheaper to implement, out come the lawyers to erase whatever perceived savings there were.
Re:Air Canada ordered to pay customer who was misled by airl... by jowea on Friday February 16, 2024 @08:22PM (#39405356)
The fines and lawsuits may be way cheaper than human staff.
Re:Air Canada ordered to pay customer who was misled by airl... by jorisboris on Friday February 16, 2024 @08:26PM (#39405387)
Especially once we have ai lawyers ;)
Re:Air Canada ordered to pay customer who was misled by airl... by photonthug on Friday February 16, 2024 @10:01PM (#39405928)
This initially sounded pretty good until I thought it through. Democratizing access to council and forcing troll lawyers to deal with trolling bots seems good but it will shape up like other spam arms races while legal systems gear up to deal with the ddos attacks. Good for spammers and most entrenched players, bad for the public at large.

Already we can’t manage to prosecute ex presidents in a timely manner before the next election cycle. If delays seem absurd now what will it be like when anything and everything remotely legal takes 10+ years and already sky-high costs triple?

Re:Air Canada ordered to pay customer who was misled by airl... by the8472 on Wednesday February 21, 2024 @11:28AM (#39455872)
Don't worry, AlphaJudge will provide swift justice at scale.
Re:Air Canada ordered to pay customer who was misled by airl... by kingo55 on Friday February 16, 2024 @08:30PM (#39405405)
Judge, I'll refer you to my legal chatbot. I rest my case.
Re:Air Canada ordered to pay customer who was misled by airl... by mortenjorck on Friday February 16, 2024 @09:49PM (#39405855)
Your selection of generative counsel has been confirmed.

Please do not navigate away from this page while the trial runs. You will receive a notification when the verdict has been reached. This may take up to a minute.

Re:Air Canada ordered to pay customer who was misled by airl... by jowea on Friday February 16, 2024 @10:07PM (#39405956)
Thank you for the best 2 paragraph cyberpunk story.
Re:Air Canada ordered to pay customer who was misled by airl... by wongarsu on Friday February 16, 2024 @08:40PM (#39405460)
It's not like human call center staff has never given anyone wrong information, or cost companies money in fines and lawsuits.

The bar LLMs have to clear to beat the average front line support operations isn't that high, as your own experience shows. And compared to a large force of badly paid humans with high turnover, LLMs are pretty consistent and easy to train to an adequate level.

They won't beat great costumer support agents, but most companies don't have many of those

Re:Air Canada ordered to pay customer who was misled by airl... by itsoktocry on Friday February 16, 2024 @08:58PM (#39405571)
>It's not like human call center staff has never given anyone wrong information, or cost companies money in fines and lawsuit

A human will be more likely to say "I don't know" or pass you along, rather than outright lie.

Re:Air Canada ordered to pay customer who was misled by airl... by KiranRao0 on Friday February 16, 2024 @09:02PM (#39405595)
I find it common for human customer support people to give inaccurate information. I don't know about "outright lying", but I've had people tell me things that are factually incorrect.
Re:Air Canada ordered to pay customer who was misled by airl... by atoav on Friday February 16, 2024 @09:36PM (#39405793)
Depends. Saying "thing X should not fail" is factually incorrect, when you called because thing X failed.

However I would not expect an airline customer support to make up a completely fictional flight that has never existed. Maybe they could confuse flights or read a number wrong, but making one up?

Re:Air Canada ordered to pay customer who was misled by airl... by erhaetherth on Friday February 16, 2024 @09:59PM (#39405915)
Humans won't fabricate too much but when confronted with yes/no questions and they have a 50-50 shot of being right and any blowback will likely be on someone else....they'll answer whatever to get you out of their hair.

Case in point, I asked my bank if they had any FX conversion fees or markup. Guy said no. I asked if there was any markup on the spread. Said no. Guess what? They absolutely mark up that spread. Their exchange rates are terrible. Just because there isn't a line-item with a fee listed doesn't mean there isn't a hidden fee in there. He's either incompetent or a liar.

Re:Air Canada ordered to pay customer who was misled by airl... by mmh0000 on Wednesday February 21, 2024 @03:01PM (#39458724)
Maybe... Over two decades ago (holy crap, I'm old), I used to work in the call center for a major airline. I was the guy you got when you complained to the 1st level rep that you wanted their manager, then you got sent to the 2nd level rep and wanted their manager. And that was me.

90% of my job was undoing and compensating passengers for the incorrect information either the phone agent or gate agent gave them. The other 10% was dealing with workarounds to technical issues in our booking software.

Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @11:13PM (#39406299)
It's still way too easy to send LLMs into a complete tangent of rambling incoherently, opening yourself up to the LLM making written statements to customers you really don't want.

I recently asked some LLMs "How many gallons in a mile?" and got some very verbose answers, which turned into feats of short story short stories when I refined to "How many gallons of milk in a mile?"

Re:Air Canada ordered to pay customer who was misled by airl... by vGPU on Sunday February 18, 2024 @09:45PM (#39425747)
I just tried the latter with gab’s AI and it was excellent.
Re:Air Canada ordered to pay customer who was misled by airl... by fennecfoxy on Friday February 23, 2024 @10:13AM (#39481516)
Only because the models have seemingly only been trained on generating text that matches a prompt, ie prompt completion. Rather than knowledge retrieval/parsing/organisation.

If part of the training was to only use knowledge sourced from a vector db and that it is allowed to use its trained knowledge only for grammar rules, phrasing or rewriting information then I think it would do a lot better.

Doesn't seem like many models are trained on prompts like "Question Q"->"[no data] I'm sorry but I don't know that" = accepted during training.

This would help immensely for not just for chatbots but for personal use too. I don't want my LLM assistant to invent a trip to Mars when I ask it "what do I have to do today" and my calendar happens to be empty.

Re:Air Canada ordered to pay customer who was misled by airl... by mynameisvlad on Friday February 16, 2024 @08:59PM (#39405578)
Sure, but there is such a thing as “the human element”. Humans aren’t perfect, and that is the expectation. That is not the same case with computers.

And especially for something where it’s just pulling data from an internal system. There is absolutely no reason to invent made up information and saying “well humans do it all the time” is just an excuse.

Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @11:00PM (#39406245)
Yes, further, expectations wise..

On the phone with a customer service rep, I might understand a little wishy washy answer, slip of the tongue or slightly inaccurate statement. I've never really had a rep lie to me, usually its just I don't knows & them escalation as needed.

There is something about the written word from a company that makes it feel more like "binding statement".

Re:Air Canada ordered to pay customer who was misled by airl... by SOLAR_FIELDS on Friday February 16, 2024 @09:49PM (#39405861)
To me that’s totally fine. I don’t even particularly care whether the LLM is better or not. The only thing they really matters is if you are gonna use that LLM, when it inevitably messes up you don’t get to claim that it wasn’t your fault because computers are hard and AI is an emerging field. IDGAF. Pay up. The fact that you dabble in emerging technologies doesn’t give you any excuse to provide lesser services
Re:Air Canada ordered to pay customer who was misled by airl... by steveBK123 on Friday February 16, 2024 @10:55PM (#39406214)
Right whether you employ a person or some software which lies, the liability should be the same.
Re:Air Canada ordered to pay customer who was misled by airl... by AdamJacobMuller on Friday February 16, 2024 @09:00PM (#39405581)
The bar isn't even that high.

They only need to increase the lawsuit/settlement amount by less than the amount the companies saves by automation.

Re:Air Canada ordered to pay customer who was misled by airl... by behringer on Friday February 16, 2024 @11:41PM (#39406422)
I think you're underestimating the quality of customer support. People are going to be out there testing every flaw in the support system, staffed or unstaffed. LLMs have no hope.
Re:Air Canada ordered to pay customer who was misled by airl... by Wowfunhappy on Saturday February 17, 2024 @08:02PM (#39415083)
> It's not like human call center staff has never given anyone wrong information, or cost companies money in fines and lawsuits.

If a company representative told me in writing (perhaps via email support) that I could claim a refund retroactively, and that turned out to not be their policy, I would still expect the company to honor what I was told in the email.

Phone calls are difficult more because there is no record of what was said. But if I had a recording of the phone call... I'm not actually sure what I would expect to happen. It's just so socially unusual to record phone calls.

Re:Air Canada ordered to pay customer who was misled by airl... by epcoa on Sunday February 18, 2024 @04:52PM (#39423811)
> It's just so socially unusual to record phone calls.

Is it? I can not remember the last time I called some business where I did not get a “this call may be monitored or recorded for quality and training purposes…”. whatever perceived social hangups the company had they got over them and you don’t even need to ask in a 2PC jurisdiction, it’s already taken care of, just record the call.

Re:Air Canada ordered to pay customer who was misled by airl... by araes on Wednesday February 21, 2024 @01:57PM (#39457941)
Which implies most humans calling any form of customer service should probably have a local audio recording, because otherwise you're in a lopsided witness situation. Don't want there to be a recording? That call just happened to not be recorded. Notably, this is getting difficult anyway with how easy it is to manufacture vocal data.