News for hackers. Stuff that matters.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by grumple on Saturday May 27, 2023 @05:17PM (#36098408)
"It doesn't lie, it just generates lies and printed them to the screen!"

I don't think there's a difference.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Bytewave81 on Saturday May 27, 2023 @05:23PM (#36098463)
To perhaps stir the "what do words really mean" argument, "lying" would generally imply some sort of conscious intent to bend or break the truth. A language model is not consciously making decisions about what to say, it is statistically choosing words which probabilistically sound "good" together.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @05:44PM (#36098649)
>A language model is not consciously making decisions about what to say

Well, that is being doubted -- and by some of the biggest names in the field.

Namely that it isn't "statistically choosing words which probabilistically sound good together". But that doing so is not already making a consciousness (even if basic) emerge.

>it is statistically choosing words which probabilistically sound "good" together.

That when we do speak (or lie), we do something much more nuanced, and not just do a higher level equivalent of the same thing, plus have the emergent illusion of consciousness, is also an idea thrown around.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by mensetmanusman on Saturday May 27, 2023 @06:12PM (#36098909)
"Well, that is being doubted -- and by some of the biggest names in the field."

An appeal to authority is still a fallacy. We don't even have a way of proving if a person is conscious, why would anyone expect we could agree if a machine is.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @06:19PM (#36098954)
>An appeal to authority is still a fallacy

Which is neither here, nor there. I wasn't making a formal argument, I was stating a fact. Take it or leave it.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by japoco on Saturday May 27, 2023 @05:29PM (#36098521)
Lying needs intent. ChatGPT does not think therefore it doesn’t lie in that sense.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by ClumsyPilot on Saturday May 27, 2023 @05:31PM (#36098541)
Thats like saying robots don't murder - they just kill
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by fallingknife on Saturday May 27, 2023 @05:34PM (#36098571)
Which is actually a very good analogy. A lot of things can kill you, but only a human can be a murderer.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by NotACop182 on Saturday May 27, 2023 @05:49PM (#36098684)
And pit bulls, but I digress. The debate gets lost in translation when we start having what do words mean debate.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by joe_the_user on Saturday May 27, 2023 @06:21PM (#36098981)
In movies and written fiction, "intelligent" robots, anthropomorphized animals, elves, dwarves and etc can all commit murder when given the attributes of humans.

We don't have real things with all human attributes but we're getting closer and as we get close "needs to be a human" will get thinner as an explanation of what is or isn't human for an act of murder, deception and so-forth.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by leereeves on Saturday May 27, 2023 @05:32PM (#36098561)
Merriam-Webster gives two definitions for the verb "lie". The first requires intent, the second does not:

> to create a false or misleading impression

> Statistics sometimes lie.

> The mirror never lies.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by joe_the_user on Saturday May 27, 2023 @05:55PM (#36098746)
This is an interesting discussion. The ideas of philosophy meet the practical meaning of words here.

You can reasonably say a database doesn't lie. It's just a tool, everyone agrees it's a tool and if you get the wrong answer, most people would agree it's your fault for making the wrong query or using the wrong data.

But the difference between ChatGPT and a database is ChatGPT will support it's assertions. It will say things that support it's position - not just fake references but an entire line of argument.

Of course, all of this is simply duplicating/simulating for humans in discussions. You can call it is a "simulated lie" if you don't like the idea of it really lying. But I claim that in normal usage, people will take this as "real" lying and ultimately that functional meaning is what "higher" more philosophical will have to accept.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by japoco on Saturday May 27, 2023 @08:14PM (#36099812)
Somewhat unrelated, but I think philosophy will be instrumental in the development of actual AI. To make artificial intelligence, you need to know what intelligence is, and that is a philosophical question.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by raincole on Saturday May 27, 2023 @05:24PM (#36098472)
Saying ChatGPT lies is like saying The Onion lies.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by ceejayoz on Saturday May 27, 2023 @05:43PM (#36098642)
The Onion (via its staff) intends to produce falsehoods. ChatGPT (nor its staff) does not.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by mod50ack on Saturday May 27, 2023 @05:25PM (#36098490)
Lying implies an intention. ChatGPT doesn't have that.

What ChatGPT definitely does do is generate falsehoods. It's a bullshitting machine. Sometimes the bullshit produces true responses. But ChatGPT has no epistemological basis for knowing truths; it just is trained to say stuff.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by lo_zamoyski on Saturday May 27, 2023 @05:47PM (#36098673)
And if you want to be pedantic, ChatGPT isn't even generating falsehoods. A falsehood requires propositional content and therefore intentionality, but ChatGPT doesn't have that. It merely generates strings that, when interpreted by a human being as English text, signify falsehoods.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by mod50ack on Saturday May 27, 2023 @06:25PM (#36099005)
Getting into the weeds, but I don't agree with this construal of what propositional content is or can be. (There is no single definition of "proposition" which has wide acceptance and specifies your condition here.) There is no similar way to assess truth outside of formalized mathematics, but the encoding of mathematical statements (think Gödel numbers) comes to mind; I don't think that the ability of the machine to understand propositions is necessary in order to make the propositions propositional; the system of ChatGPT is designed in order to return propositional content (albeit not ex nihilo, but according to the principles of its design) and this could be considered analogous to the encoding of arithmetical symbolic notation into an formally-described system. The difference is just that we happen to have a formal description of how some arithmetic systems operate, which we don't (and I would say can't) have for English. Mild throwback to my university days studying all of this!
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by acka on Saturday May 27, 2023 @05:24PM (#36098474)
Does a piece of software with a bug in it which causes it to produce incorrect output lie or is it simply a programming error? Did the programmer who wrote the buggy code lie? I don't think so.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by zdragnar on Saturday May 27, 2023 @05:26PM (#36098495)
The difference is everything. It doesn't understand intent, it doesn't have a motivation. This is no different than what fiction authors, songwriters, poets and painters do.

The fact that people assume what it produces must always be real because it is sometimes real is not its fault. That lies with the people who uncritically accept what they are told.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by hoistbypetard on Saturday May 27, 2023 @05:43PM (#36098646)
> That lies with the people who uncritically accept what they are told.

That's partly true. Just as much fault lies with the people who market it as "intelligence" to those who uncritically accept what they are told.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by williamcotton on Saturday May 27, 2023 @05:58PM (#36098767)
This is displayed directly under the input prompt:

ChatGPT may produce inaccurate information about people, places, or facts.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by hoistbypetard on Saturday May 27, 2023 @06:33PM (#36099080)
That's a good start. I think it needs to be embedded in the output.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Dalewyn on Saturday May 27, 2023 @05:28PM (#36098510)
An exceedingly complicated Autocomplete program, which an "AI" like ChatGPT is, does not have motives, does not know the concept of "lying" (nor any concept thereof), and simply does things as ordered by its user.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by wvenable on Saturday May 27, 2023 @05:47PM (#36098669)
It's a text generator. You ask it generate something and it does. It produces only stories. Sometimes those stories are based on actual facts.

This lawyer told it produce a defence story and it did just that.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by icedchai on Saturday May 27, 2023 @06:12PM (#36098904)
There is a difference. Is fiction a lie?
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by kristjansson on Saturday May 27, 2023 @07:26PM (#36099446)
Language generated without regard to its truth value is different than language that cares about its truth value. Ask Harry Frankfurt.