News for hackers. Stuff that matters.
Re:Why neural networks struggle with the Game of Life (2020) by nottorp on Friday May 17, 2024 @07:25AM (#40388690)
Let's be snarky a bit:

Can you do a neural network that, given a starting position of the game of life, decides if it cycles or not? ;)

Ok, not cycles... dies, stabilizes, goes into a loop etc.

Re:Why neural networks struggle with the Game of Life (2020) by GrantMoyer on Friday May 17, 2024 @07:45AM (#40388845)
So Oracle's working on an LLM to, eh?
Re:Why neural networks struggle with the Game of Life (2020) by nottorp on Friday May 17, 2024 @08:00AM (#40388929)
<cough> halting problem. But now I'm spoiling it.
Re:Why neural networks struggle with the Game of Life (2020) by markisus on Friday May 17, 2024 @08:22AM (#40389114)
We know neural networks cannot solve the halting problem. But isn’t the question whether they can learn the transition table for game of life? Since each cell depends only on neighbors, this is as easy as memorizing how each 3x3 tile transitions.
Re:Why neural networks struggle with the Game of Life (2020) by nottorp on Friday May 17, 2024 @08:30AM (#40389167)
The original question, maybe. Mine is basically the halting problem, I think.

The other difference is I don't take it seriously.

Re:Why neural networks struggle with the Game of Life (2020) by theGnuMe on Saturday May 18, 2024 @08:05AM (#40398292)
Wolfram looked at this recently on his blog.

https://writings.stephenwolfram.com/2024/05/why-does-biologi...

He says it's possible for smaller games (fewer rules) but unlikely for larger ones.. IMHO anything Turing complete would have this problem.

Re:Why neural networks struggle with the Game of Life (2020) by DeathArrow on Friday May 17, 2024 @07:55AM (#40388905)
Everybody and their mom are into LLMs.
Re:Why neural networks struggle with the Game of Life (2020) by brookst on Friday May 17, 2024 @08:07AM (#40389005)
Same thing happened with the Internet.
Re:Why neural networks struggle with the Game of Life (2020) by yumong on Friday May 17, 2024 @08:09AM (#40389023)
And Second Life and Myspace.
Re:Why neural networks struggle with the Game of Life (2020) by catlifeonmars on Friday May 17, 2024 @08:33AM (#40389187)
For a grid of a fixed size, yes.
Re:Why neural networks struggle with the Game of Life (2020) by scarmig on Friday May 17, 2024 @06:18PM (#40394673)
The halting problem doesn't mean you can never decide if something cycles etc, just that you can't always decide.

As it stands, my guess is that the LLM would always confidently make a decision, even if it were wrong, and then politely backtrack if you pushed backed, even if it were originally right.