News for hackers. Stuff that matters.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @02:25PM (#34537334)
Hold on, at least for me, 90% of the stuff is not just coherent-looking, but coherent. I do think that when it's wrong, it should give a heads up about not being certain about a subject. It's certainly tweaked to sound almost overconfident about every subject, which gives off a bullshitty vibe when the details of the explanation are wrong.

What sorts of subjects have you been trying it out with?

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by trefoiled on Thursday January 26, 2023 @02:34PM (#34537486)
I think part of the point here is that ChatGPT has no clue what you might mean here by "certainty" or being "wrong," and the fact that people have the impression that it could have an idea of those concepts is indicative of people's poor understanding of what ChatGPT really is
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by visarga on Thursday January 26, 2023 @02:39PM (#34537583)
Are you talking about the same people who couldn't agree about a vaccine? How is logical consistency going with humans?

Not to mention that a mere 700 years ago we were dying of bubonic plague and with all our general intelligence could not muster up the germ theory of disease. Not even to save our lives, you see, we are not generally general in our intelligence either, and make tons of mistakes.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @03:35PM (#34538397)
Could you elaborate on this?

It definitely is able to decipher whether it has knowledge about the future, or some specific political events. This is obviously a pretty straightforward bonus layer on top of the model itself, but couldn't there be an extrapolation of that system where it's not binary, but rather a range between 0 and 1? I'd imagine this wouldn't be the model itself doing the crunching of the previous tokens here, at least not the same instance of it, as it could be stuck in whatever character or loop of reasoning it has going on at the moment.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by fnordpiglet on Thursday January 26, 2023 @02:50PM (#34537737)
I’ve had pretty complex discussions about Buddhism, physics, and other subjects and it was generally erudite and accurate. In its current unrefined form it’s more useful than google is at providing understanding on most subjects, especially because it will attempt to answer my direct questions rather than providing documents with terms in them. In fact I think it’s probably one of the most useful tools I’ve ever used.

Has it given me wrong information? Absolutely. But it’s always been pretty obviously wrong, and I often use it to introduce me to a subject then follow up with google to verify details. I further fully expect this to improve.

Re:Yann LeCun: ChatGPT is 'not particularly innovative' by helloplanets on Thursday January 26, 2023 @03:46PM (#34538576)
Yes, I've been going back and forth between Google and ChatGPT quite a bit lately. Sort of using Google as the verification step, after getting deeper into a subject.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by fnordpiglet on Thursday January 26, 2023 @04:36PM (#34539177)
For the haters, it seems incredibly likely that an IR system like google will be augmenting LLM and semantic reasoning systems to form a solution to the problems folks point. The problems chatgpt suffer from are solved and are complementary.