Re:Transformer neural net learns to run Conway's Game of Lif...
by montebicyclelo on Saturday May 17, 2025 @08:55AM
(#44013958)
It wasn't obvious that a transformer could do this, and learn to produce conv via attention
[ Parent
| on HN ]
Re:Transformer neural net learns to run Conway's Game of Lif...
by artemisart on Saturday May 17, 2025 @10:36AM
(#44014635)
But it is, as long as the positional embedding are sufficient, i.e. use relative positional embeddings here.