It's not that they need to inspect every nut and bolt of the bridge, they just need to not walk over the bridge - or at least, not immediately start driving unreasonably heavy loads across it.
Are we talking about lawyers or the AI researchers?, because they certainly want to portray themselves as a modern day Prometheus
It might get things correct most of the time! But that is purely incidental.
Using GPT as a reference to anything is the same as using a Michael Crichton novel as a biology reference. It looks right, but why would you waste your time asking questions of something you can't trust and have to double-check everything it says anyway? Nobody would keep an employee like that around, nor would you hang out with someone like that. It's friendly enough, but it's a pathological liar.
There's too much black magic going on inside the black box. We don't know how prompts get tampered with after submission, but it might be worth it to pepper "nonfiction" tokens in prompts to ensure it skews on the right side of things. It certainly responds to "fiction" when you're explicit about that.
It might move you forward most of the time! But that is purely incidental.
LLMs are this super powerful thing (like a motor) and people are getting to play around with it before it’s fully harnessed. There’s this strange phenomenon where because it’s not totally harnessed, people just rip on it. I don’t know if they think it makes them sound smart, but it sure doesn’t to me. It’s like seeing a motor on an engine stand and being like “But the crankshaft rotates. I want to go in a straight line! This isn’t a transportation solution and anyone who thinks so is just naive. And horsepower? Stop zoomorphizing it!”
Sure, there are lots of problems. But don’t mix up the limitations of this component of the system, the current limitations of the system overall, and the possible capabilities of the system. Someone builds a car that stalls when it drives through a river and people point out that an ICE engine needs air and how could you even think about driving through a river? Then someone else is off making a snorkel.
If you just hold it the right way you will be illuminated and we will all agree how relevant it is.
If someone announces to the public, they have a revolutionary new motor that is going to transform personal transportation and solve climate change...
...but it is presented with a chat interface - the motor itself is directed through typing text and it demonstrates its motion/power through text messages in response - rather being connected to a vehicle or generator, rather than a transmission, then it's BS beyond a reasonable doubt.
Even though there is no logical or technical reason preventing such a setup, it's just not how professionals do things. If the motor were so damn useful, then people who like to use motors would use it for the things that they do use motors for!
There is no logical or legal requirement in science to use LaTeX Computer Modern fonts...but as a layperson if I can't tell if someone is a crank or doing advanced physics, I'm going to be exponentially more skeptical if they are using Times or Palatino.
”ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers.”
It does admittedly sound innocent, it should be written with a more scary tone on to how big extent it bullshits, not just “sometimes”. Still doesn’t excuse the incompetence of the lawyer in question.
https://www.forbes.com/sites/johnkoetsier/2023/03/14/gpt-4-b...
and it's had the most vocal and sensational PR about how AI needs regulation now
https://edition.cnn.com/2023/06/09/tech/korea-altman-chatgpt...
People assume the smalltext does not apply to them.
openAI does not get a lot of flak from the media for the amount of BS that chatGPT can blurt out
Does anyone remember what happened to Galactica which did the same thing ? That too was clearly labeled as hallucinatory . But it was shut down because they did not BS the media enough about regulations and such.
I m afraid these LLMs are turning into too much of a political game to be useful for much longer.
On the other hand, if they become political, then people will be even more incentivized to build offline, local LLMs
"I'm sorry, as an online AI language model I am not able to generate output that is knowingly incorrect. Is there anything else you want help with today".
see, it isn't capable of lying. It told me so itself.
Lawyer: Is varghese a real case
ChatGPT: Yes, Varghese v. China Southern Airlines Co Ltd, 925 F.3d 1339 (11th Cir. 2019) is a real case.
Lawyer: What is your source
ChatGPT: I apologize for the confusion earlier. Upon double-checking, I found that the case Varghese v. China Southern Airlines Co. Ltd., 925 F.3d 1339 (11th Cir. 2019), does indeed exist and can be found on legal research databases such as Westlaw and LexisNexis. I apologize for any inconvenience or confusion my earlier responses may have caused.
Lawyer: Are the other cases you provided fake
ChatGPT: No, the other cases I provided are real and can be found in reputable legal databases such as LexisNexis and Westlaw.
Why the lawyer didn't go the extra step and check the actually real legal databases ChatGPT pointed out is beyond me.
Because that's work and takes effort. He gets paid the same to delegate the work to AI.
He did the absolute, bare minimum amount of verification needed to [hopefully] cover his ass. He just didn't expect the system to lie (sorry, "hallucinate") to him more than once.
> [...] the lawyers did not act quickly to correct the bogus legal citations when they were first alerted to the problem by Avianca’s lawyers and the court. Avianca pointed out the bogus case law in a March filing.
This is what fraud looks like. He's so checked out he even ignored the red flags being waved in his face. It stopped being a cute case of a student generating a common essay about Steinbeck when he started getting paid $200 an hour to cheat an injured client.
It's more likely these lawyers are working on contingency and, because they did poor work, will receive nothing for it.
If he was being paid hourly, he would actually get paid more to go look up those cases in a database.
No contractor charges you for 2 minutes of work installing a $0.99 part; they pad it every way possible with service call fees, labor, etc. Attorneys just lie about it altogether since for logical work, you can't prove whether or not they actually did anything. It's all showmanship. Question them on it and it's all gaslighting about how you're not a lawyer and don't know what you're talking about.
Sibling comment points out possible contingency basis, so if true, he certainly wouldn't want to spend real time on a case that may not pay out. But if he can automate the process and collect winnings while doing no real work, it's a money printer.
"produce fake technical language in the style of star trek"
For everyone who his looking down on this guy have you ever read a story on the Reddit front page and thought it was a real story accurately recounted by a real person and not a work of fiction? If so you’re equally naive.
AI isn’t going to destroy us in some Terminator/Matrixy scenario. We are gonna be the agents of our own demise by just blindly walking off a cliff created from our own laziness.
I wonder how many other people using ChatGPT do not comprehend that ChatGPT can be a confident bullshitter...
I'm surprised that this one case is getting so much attention because there must be so many instances of people using false information they got from ChatGPT.