News for hackers. Stuff that matters.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by visarga on Thursday January 26, 2023 @02:13PM (#34537118)
> and only gives you the most-likely response to your prompt

That "only" carries a lot of weight on its back.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by oxfordmale on Thursday January 26, 2023 @02:19PM (#34537232)
The most likely response is not necessarily an accurate response. It claims dogs do not give birth to babies. That is indeed the most likely response as babies are mostly, but not exclusively, associated with humans. However, a five year old child would understand me if I told them my dog had babies.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by fnordpiglet on Thursday January 26, 2023 @02:37PM (#34537536)
Have you used chatgpt much?

I asked your prompt:

Do dogs give birth to babies?

> Dogs give birth to puppies.

I had a long discussion about the expansion do space and the Hubble constant, and tried to trick it in a variety of ways. It was correct in everything even though it wasn’t able to go into proofs and likewise. I then tried to convince it that the universe began as a small potato and wasn’t able to do it without directly telling it to assume it is and to create fiction off that concept. It was then able to make a credible theory of what the universe would be like if it started as a small potato, even going into how the texture of the potato would have caused variations in the density of mass, etc. Even then it would find ways to sneak in this isn’t true and that the universe was never a small potato. This is remarkable no matter the actual reality of what’s going on behind the scenes.

I would also note that human thought is just a bunch of gradient functions in the electrochemical space, and thus also follows a most likely path.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by oxfordmale on Thursday January 26, 2023 @04:25PM (#34539057)
Yes, I have tried ChatGPT, and it told me dogs do not give birth to babies. However, ChatGPT doesn't provide deterministic answers and improves responses over time. Many of the internet examples no longer work.

I asked, "If a woman gives birth to a baby in 9 months, how many months does a dog take to give birth to a baby."

It answered, "Dogs do not give birth to babies."

Currently, it answers, "On average, a dog's gestation period (the amount of time it takes for a dog to give birth to puppies) is approximately nine weeks or 63 days."

It still doesn't understand pregnancy is a concurrent event (women can be pregnant at the same time)

Q: If a woman takes nine months to give birth to a baby, how long does it take a billion women to give birth to one baby?

A: It would take approximately 2.7 million years for a billion women to give birth to one baby.

I do love ChatGPT to help me write certain documents. For example, for a performance review, you can give it bullet points and ask to write a review. After correcting it with Grammarly, it is usually better than what I would have written.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by TchoBeer on Thursday January 26, 2023 @05:38PM (#34539897)
>I asked, "If a woman gives birth to a baby in 9 months, how many months does a dog take to give birth to a baby." It answered, "Dogs do not give birth to babies."

to be fair, I'd probably say the same thing lol. "Baby" in this context was already primed to mean "human child."

>Q: If a woman takes nine months to give birth to a baby, how long does it take a billion women to give birth to one baby?

>A: It would take approximately 2.7 million years for a billion women to give birth to one baby.

I asked the same and it answered "It would still take 9 months for a billion women to give birth to one baby, as the length of time it takes for a woman to give birth is not affected by the number of women giving birth simultaneously."

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by hgsgm on Thursday January 26, 2023 @05:56PM (#34540065)
> For example, for a performance review, you can give it bullet points and ask to write a review.

Please don't do this. It obfuscates what you are trying to communicate. You are harming your communication and your relationship.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by dns_snek on Friday January 27, 2023 @05:55AM (#34544693)
Still not as bad as it's going to be. I'd wager that within a year someone's going to write a script that compares your GitHub contributions against your peers, feeds all of your Slack/email conversations into ChatGPT for professionalism, tone, and helpfulness analysis and feeds it back into ChatGPT to produce a completely automated "performance review".
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by ryandvm on Friday January 27, 2023 @09:39AM (#34546519)
That's fine because within a year my and my peers are going to let ChatGPT write all our code and handle all our code review requests. It's going to be AI all the way down.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by oxfordmale on Friday January 27, 2023 @02:25PM (#34550545)
I am after a rewrite in more elegant language than I can produce myself. I do not auto-accept the review; it is a good starting point for me to tweak. Any written performance review is followed up by a face-to-face meeting to clarify anything written down. ChatGPT is a tool, not magic, however, I find it helps with writers block.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by smoldesu on Thursday January 26, 2023 @02:17PM (#34537191)
As far as most people can be fooled by coherent-looking text.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @02:25PM (#34537334)
Hold on, at least for me, 90% of the stuff is not just coherent-looking, but coherent. I do think that when it's wrong, it should give a heads up about not being certain about a subject. It's certainly tweaked to sound almost overconfident about every subject, which gives off a bullshitty vibe when the details of the explanation are wrong.

What sorts of subjects have you been trying it out with?

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by trefoiled on Thursday January 26, 2023 @02:34PM (#34537486)
I think part of the point here is that ChatGPT has no clue what you might mean here by "certainty" or being "wrong," and the fact that people have the impression that it could have an idea of those concepts is indicative of people's poor understanding of what ChatGPT really is
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by visarga on Thursday January 26, 2023 @02:39PM (#34537583)
Are you talking about the same people who couldn't agree about a vaccine? How is logical consistency going with humans?

Not to mention that a mere 700 years ago we were dying of bubonic plague and with all our general intelligence could not muster up the germ theory of disease. Not even to save our lives, you see, we are not generally general in our intelligence either, and make tons of mistakes.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @03:35PM (#34538397)
Could you elaborate on this?

It definitely is able to decipher whether it has knowledge about the future, or some specific political events. This is obviously a pretty straightforward bonus layer on top of the model itself, but couldn't there be an extrapolation of that system where it's not binary, but rather a range between 0 and 1? I'd imagine this wouldn't be the model itself doing the crunching of the previous tokens here, at least not the same instance of it, as it could be stuck in whatever character or loop of reasoning it has going on at the moment.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by fnordpiglet on Thursday January 26, 2023 @02:50PM (#34537737)
I’ve had pretty complex discussions about Buddhism, physics, and other subjects and it was generally erudite and accurate. In its current unrefined form it’s more useful than google is at providing understanding on most subjects, especially because it will attempt to answer my direct questions rather than providing documents with terms in them. In fact I think it’s probably one of the most useful tools I’ve ever used.

Has it given me wrong information? Absolutely. But it’s always been pretty obviously wrong, and I often use it to introduce me to a subject then follow up with google to verify details. I further fully expect this to improve.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @03:46PM (#34538576)
Yes, I've been going back and forth between Google and ChatGPT quite a bit lately. Sort of using Google as the verification step, after getting deeper into a subject.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by fnordpiglet on Thursday January 26, 2023 @04:36PM (#34539177)
For the haters, it seems incredibly likely that an IR system like google will be augmenting LLM and semantic reasoning systems to form a solution to the problems folks point. The problems chatgpt suffer from are solved and are complementary.