Re:Transformer neural net learns to run Conway's Game of Lif...
by Philpax on Saturday May 17, 2025 @08:24AM
(#44013771)
It's a theoretical result to help determine what they're capable of, not a practical solution. Of course you can write the code yourself - but that's not the point!
[ Parent
| on HN ]
Re:Transformer neural net learns to run Conway's Game of Lif...
by lynndotpy on Saturday May 17, 2025 @08:30AM
(#44013794)
Well, you could also implement this by hand-writing weights for one convolution layer.
There are only 512 training examples needed for that, and it would be a lot more interesting if a learning algorithm were able to fit that 3x3 convolution layer from those 512 examples. IIRC, and don't quote me on that, but that's not been done.