News for hackers. Stuff that matters.
Re:Transformer neural net learns to run Conway's Game of Lif... by montebicyclelo on Saturday May 17, 2025 @08:55AM (#44013958)
It wasn't obvious that a transformer could do this, and learn to produce conv via attention
Re:Transformer neural net learns to run Conway's Game of Lif... by artemisart on Saturday May 17, 2025 @10:36AM (#44014635)
But it is, as long as the positional embedding are sufficient, i.e. use relative positional embeddings here.