News for hackers. Stuff that matters.
Re:Transformer neural net learns to run Conway's Game of Lif... by Philpax on Saturday May 17, 2025 @08:24AM (#44013771)
It's a theoretical result to help determine what they're capable of, not a practical solution. Of course you can write the code yourself - but that's not the point!
Re:Transformer neural net learns to run Conway's Game of Lif... by lynndotpy on Saturday May 17, 2025 @08:30AM (#44013794)
Well, you could also implement this by hand-writing weights for one convolution layer.

There are only 512 training examples needed for that, and it would be a lot more interesting if a learning algorithm were able to fit that 3x3 convolution layer from those 512 examples. IIRC, and don't quote me on that, but that's not been done.