News for hackers. Stuff that matters.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @05:42PM (#36098635)
>ChatGPT did not lie; it cannot lie.

If it lies like a duck, it is a lying duck.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Karellen on Saturday May 27, 2023 @06:00PM (#36098786)
Lying implies intent, and knowing what the truth is. Saying something you believe to be true, but is wrong, is generally not considered a lie but a mistake.

A better description of what ChatGPT does is described well by one definition of bullshit:

> bullshit is speech intended to persuade without regard for truth. The liar cares about the truth and attempts to hide it; the bullshitter doesn't care if what they say is true or false

-- Harry Frankfurt, On Bullshit, 2005

https://en.wikipedia.org/wiki/On_Bullshit

ChatGPT neither knows nor cares what the truth is. If it bullshits like a duck, it is a bullshitting duck.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @06:02PM (#36098807)
>Lying implies intent, and knowing what the truth is. Saying something you believe to be true, but is wrong, is generally not considered a lie but a mistake.

Those are the semantics of lying.

But "X like a duck" is about ignoring semantics, and focusing not on intent or any other subtletly, but only on the outward results (whether something has the external trappings of a duck).

So, if it produces things that look like lies, then it is lying.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Karellen on Saturday May 27, 2023 @06:12PM (#36098901)
A person who is mistaken looks like they're lying. That doesn't mean they're actually lying.

That's the thing people are trying to point out. You can't look at something that looks like it's lying and conclude that it's lying, because intent is an intrinsic part of what it means to lie.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @06:21PM (#36098972)
Even for that, you'd be surprised:

(1) get oneself into or out of a situation by lying. "you lied your way on to this voyage by implying you were an experienced crew"

(2) (of a thing) present a false impression. "the camera cannot lie"

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Karellen on Saturday May 27, 2023 @06:35PM (#36099092)
1) sounds like intent is present there?

2) "the camera cannot lie" - cameras have no intent?

I feel like I'm missing something from those definitions that you're trying to show me? I don't see how they support your implication that one can ignore intent when identifying a lie. (It would help if you cited the source you're using.)

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by dendriti on Saturday May 27, 2023 @07:42PM (#36099585)
If I use ChatGPT to "hallucinate" a source, and post it here, am I lying?
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by Dylan16807 on Saturday May 27, 2023 @08:10PM (#36099781)
Did you get it to hallucinate on purpose, or perform willful ignorance? Then yes. Otherwise probably not.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by tankenmate on Sunday May 28, 2023 @10:53AM (#36104489)
either a) you knew it was false before posting, then yes you are lying. Or b) you knew there was a high possibility that ChatGPT could make things up, in which case you aren't lying per se, but engaging in reckless behaviour. If your job relies on you posting to HN, or you know and accept that others rely on what you post to HN then you are probably engaging in gross recklessness (like the lawyer in the article).
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @08:16PM (#36099833)
>2) "the camera cannot lie" - cameras have no intent?

The point was that the dictionary definition accepts the use of the term lie about things that can misrepresent something (even when they're mere things and have no intent).

The dictionary's use of the common saying "the camera cannot lie" wasn't to argue that cameras don't lie because they don't have intent, but to show an example of the word "lie" used for things.

I can see how someone can be confused by this when discussing intent, however, since they opted for a negative example. But we absolutely do use the word for inanimate things that don't have intent too.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by grt_thr on Saturday May 27, 2023 @06:24PM (#36099001)
Ironically enough this sounds exactly like how bing was justifying it's gas lighting before it got lobotomised.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by unusualmonkey on Saturday May 27, 2023 @06:52PM (#36099210)
> So, if it produces things that look like lies, then it is lying.

Lying depends upon context.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by emodendroket on Saturday May 27, 2023 @06:06PM (#36098835)
You could say that calling it "lying" is unduly anthropomorphizing the LLM, but then so is saying it "believes" something to be true.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by massysett on Saturday May 27, 2023 @06:44PM (#36099156)
I’ve come to the belief that making statements that may or may not be true, but with reckless disregard for whether or not they actually are true, is indeed lying.

Of course we know ChatGPT cannot lie like a human can, but a big reason the thing exists is to assemble text the same way humans do. So I think it’s useful rhetorically to say that ChatGPT, quite simply, lies.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by tankenmate on Saturday May 27, 2023 @07:02PM (#36099283)
But since this is about the law; ChatGPT can't lie because there is no mens rea. And of course this is a common failing with the common person when it comes to the law, a reckless disregard there of (until it is too late of course). And recklessness is also about intent, it is a form of wantonness, i.e. selfishness. This is why an insane person cannot be found guilty, you can't be reckless if you are incapable of discerning your impact on others.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by cyanydeez on Saturday May 27, 2023 @08:16PM (#36099825)
Anyone who repeats chatgpt knowing is fallibility is lying, or deceitful.

Chatgpt is a device unlike Wikipedia,

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by tankenmate on Sunday May 28, 2023 @10:46AM (#36104429)
It's not lying if ChatGPT is correct (which it often is), so repeating ChatGPT isn't lying (since ChatGPT isn't always wrong); instead the behaviour is negligent or in the case of a lawyer grossly negligent since a lawyer should know better to check if it is correct before repeating it.

As always mens rea is a very important part of criminal law. Also, just because you don't like what someone says / writes doesn't mean it is a crime (even if it is factually incorrect).

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by olalonde on Saturday May 27, 2023 @05:53PM (#36098732)
It doesn't lie like a duck. It unintentionally says falsehoods. Lying is intentional.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Saturday May 27, 2023 @05:58PM (#36098764)
That's irrelevant to whether it lies like a duck or not.

The expression "if it X like a duck" means precisely that we should judge a thing to be a duck or not, based on it having the external appereance and outward activity of a duck, and ignoring any further subleties, intent, internal processes, qualia, and so on.

In other words, "it lies like a duck" means: if it produces things that look like lies, it is lying, and we don't care how it got to produce them.

So, Chat-GPT absolutely does "lie like a duck".

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by throwaway675309 on Saturday May 27, 2023 @06:35PM (#36099089)
I disagree, people are already anthropomorphizing GPT enough without bringing in a loaded word like lying which implies intent.

Hallucinates is a far more accurate word.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by wlonkly on Sunday May 28, 2023 @10:25PM (#36109898)
What bothers me about "hallucinates" is the removal of agency. When a human is hallucinating, something is happening to them that is essentially out of their control and they are suffering the effects of it, unable to tell truth from fiction, a dysfunction that they will recover from.

But that's not really what happens with ChatGPT. The model doesn't know truth from fiction in the first place, but the whole point of a useful LLM is that there is some level of control and consistency around the output.

I've been using "bullshitting", because I think that's really what ChatGPT is demonstrating -- not a disconnection from reality, but not letting truth get in the way of a good story.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by olalonde on Saturday May 27, 2023 @07:18PM (#36099392)
I know what the expression means, I just disagree that ChatGPT looks like a "lying duck". ChatGPT just seems like it occasionally says incorrect things unintentionally. A "lying duck" would look and behave differently, even outwardly. For example, it would be more consistent in its lies. It would also be a groundbreaking discovery in AI and might signal that it's time to pull the plug on ChatGPT's servers for a while.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by imgabe on Saturday May 27, 2023 @07:58PM (#36099698)
> we should judge a thing to be a duck or not, based on it having the external appereance and outward activity of a duck, and ignoring any further subleties, intent, internal processes, qualia, and so on.

and the point here is we should not ignore further subtleties, intent, internal process, qualia, etc because they are extremely relevant to the issue at hand.

Treating GPT like a malevolent actor that tells intentional lies is no more correct than treating it like a friendly god that wants to help you.

GPT is incapable of wanting or intending anything, and it's a mistake to treat it like it does. We do care how it got to produce incorrect information.

If you have a robot duck that walks like a duck and quacks like a duck and you dust off your hands and say "whelp that settles it, it's definitely a duck" then you're going to have a bad time waiting for it to lay an egg.

Sometimes the issues beyond the superficial appearance actually are important.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by coldtea on Sunday May 28, 2023 @09:31AM (#36103834)
>and the point here is we should not ignore further subtleties, intent, internal process, qualia, etc because they are extremely relevant to the issue at hand.

But the point is those are only relevant when trying to understand GPTs internal motivations (or lack thereof).

If we care for the practical effects of what it's spits out (the function the same as if GPT has lied to us), then calling them "hallucinations" is as good as calling them "lying".

>We do care how it got to produce incorrect information.

Well, not when trying to access whether it's true or false, and whether we should just blindly trust it.

From that practical aspect, most people care about (than about whether it has "intentions"), we can ignore any of its internal mechanics.

Thus treating it like it "beware, as it tends to lie", will have the same utility for most laymen (and be a much easier shortcut) than any more subtle formulation.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by lamontcg on Saturday May 27, 2023 @06:24PM (#36098998)
It doesn't really matter.

This always bugs me about how people judge politicians and other public figures not by what they've actually done, but some ideal of what is in their "heart of hearts" and their intentions and argue that they've just been constrained by the system they were in or whatever.

Or when judging the actions of nations, people often give all kinds of excuses based on intentions gone wrong (apparently forgetting that whole "road to hell is paved with good intentions" bit).

Intentions don't really matter. Our interface to everyone else is their external actions, that's what you've got to judge them on.

Just say that GPT/LLMs will lie, gaslight and bullshit. It doesn't matter that they don't have an intention to do that, it is just what they do. Worrying about intentions just clouds your judgement.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by kaitai on Saturday May 27, 2023 @07:49PM (#36099633)
Hear hear!

Too much attention on intentions is generally just a means of self-justification and avoiding consequences and, when it comes right down to it, trying to make ourselves feel better for profiting from systems/products/institutions that are doing things that have some objectively bad outcomes.

Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by aaronblohowiak on Saturday May 27, 2023 @05:49PM (#36098694)
Hallucinated not lied.
Re:Lawyer cites fake cases invented by ChatGPT, judge is not... by revertmean on Saturday May 27, 2023 @06:48PM (#36099182)
If it quacks like a duck, it's more likely that's it one of these https://www.amazon.co.uk/Zyyini-Whistle-Carring-Suitable-Bar...