News for hackers. Stuff that matters.
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by avgcorrection on Thursday February 09, 2023 @05:31PM (#34732619)
The problem with this facile view of things is that it seems to be a dead end for scientific theories. What if we just limited the science of birds to explaining how limb-flapping could produce levitation? Hmm yes. Birds are kind of like helicopters, it seems. Who’s to say that they are not basically one and the same? Moving on.

If you are only interested in the most superficial tests and theories—like the Turing Test—then consider psychology conquered once you’ve tricked a human with your chat bot. Game Over. And what did you learn...?

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by curiousllama on Thursday February 09, 2023 @05:34PM (#34732643)
> What if we just limited the science of birds to explaining how limb-flapping could produce levitation? Hmm yes. Birds are kind of like helicopters, it seems. Who’s to say that they are not basically one and the same? Moving on.

Well said. I'm gonna steal this explanation.

Also reminds me of the famous Carbonara quote: "if my grandmother had wheels, then she would be a bike" [1]

[1] https://www.youtube.com/watch?v=A-RfHC91Ewc

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by HTTP418 on Saturday February 11, 2023 @08:20PM (#34758419)
> "if my grandmother had wheels, then she would be a bike"

Well it could be argued that she would be a bike. Its possible to be multiple things at once. If she had 2 wheels and could be ridden by other humans to a destination she might qualify has a bike. She would also continue to be your grandmother.

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by s0ulphire on Thursday February 09, 2023 @05:47PM (#34732824)
The question being asked was "what it would mean under this definition of knowing things for a machine learning algorithm to ever know something". Aside from your answer being rude, it's also unhelpful in that it doens't address the question asked and instead relies on reductio ad absurdum to pretend to make a point.

If you'd like to take a crack at a helpful answer, perhaps educate us all on what it WOULD take for you to consider a NN to actually "know" something in the same way that we say a human or other sentient animal does.

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by avgcorrection on Saturday February 18, 2023 @03:05PM (#34850516)
> Aside from your answer being rude, it's also unhelpful in that it doens't address the question asked and instead relies on reductio ad absurdum to pretend to make a point.

That is indeed often the kind of answer that a philosophical question deserves.

> If you'd like to take a crack at a helpful answer, perhaps educate us all on what it WOULD take for you to consider a NN to actually "know" something in the same way that we say a human or other sentient animal does.

How many angels can dance on the head of a pin?

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by bryan0 on Thursday February 09, 2023 @05:58PM (#34732954)
> The problem with this facile view of things is that it seems to be a dead end for scientific theories.

You're overreaching quite a bit here, or I think you're misinterpreting what Parent said. I interpreted what they said as: it seems the difference in how we "know" something vs how an LLM "knows" something might actually be closer than some suspect. this certainly is not an "end of science".

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by avgcorrection on Saturday February 18, 2023 @03:19PM (#34850634)
Not the end. Just the exact opposite attitude that an inquisitive and humble scientist should have. So unlikely to go anywhere.

A “scientist” looks out at his living room. My Roomba and my cat have their own lifes. Who’s to say that they are not in fact the same in kind (but not degreee)? Good luck with that, professor.

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by shawnz on Thursday February 09, 2023 @06:00PM (#34732975)
> If you are only interested in the most superficial tests and theories—like the Turing Test—then consider psychology conquered once you’ve tricked a human with your chat bot.

What's the counterargument? What's a less superficial test that we can use instead, which conclusively shows that actually human minds aren't just like very sophisticated LLMs? There isn't one -- this is nothing but the same Chinese room problem which we've been discussing for decades. The topmost poster is simply assuming that language models can't possibly understand the same way a human does without relying on any kind of "test" at all, which I think is the real scientific dead end here.

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by avgcorrection on Saturday February 18, 2023 @03:04PM (#34850495)
> (though in general I think the favored “alignment” frames of the LessWrong community are not even wrong).

The Turing Test doesn’t test humans. So you cannot use it to show any properties about humans.

Next!

> The topmost poster is simply assuming that language models can't possibly understand the same way a human does without relying on any kind of "test" at all, which I think is the real scientific dead end here.

Sounds unfalsifiable. So yes.

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by shawnz on Saturday February 18, 2023 @03:25PM (#34850703)
If you are actually interested in this problem why not try interpreting what I'm saying a bit more charitably and not waste your time replying with snark?
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by psb217 on Thursday February 09, 2023 @06:22PM (#34733191)
How is the request that someone provide a clear set of definitions and some empirically falsifiable hypotheses a "dead end for scientific theories"? It seems more like the foundation of the scientific method.
Re:Theory of Mind May Have Spontaneously Emerged in Large La... by avgcorrection on Saturday February 18, 2023 @03:16PM (#34850606)
> and some empirically falsifiable hypotheses

Where?

Re:Theory of Mind May Have Spontaneously Emerged in Large La... by HTTP418 on Saturday February 11, 2023 @08:28PM (#34758488)
> Birds are kind of like helicopters, it seems.

We could easily argue that birds are not a type of helicopter because for helicopter's we have a very specific set of flying properties required. It must have a main propeller for lift and a tail propeller to counter balance the main propeller from spinning the helicopter. If a bird flew with similar mechanism I would argue it was a helicopter.

We don't have a 100% accurate gauge for ToM as far as we know. This paper simply uses some of the best known tests for ToM and then states that either LLM can lead to emergent properties or that the current tests for ToM need to be re-thought.