News for hackers. Stuff that matters.

A comment on Generative Modeling with Sparse Transformers. Parent comment

Re:Generative Modeling with Sparse Transformers by skdotdan on Tuesday April 23, 2019 @06:14PM (#19733508)
Are Transformers based on convolutions?
[ Parent | on HN ]
Re:Generative Modeling with Sparse Transformers by joe_the_user on Tuesday April 23, 2019 @06:32PM (#19733644)
"Convolutional neural networks", whose connection to other means of convolution is a bit tenuous.

https://en.wikipedia.org/wiki/Convolutional_neural_network

[ Parent | on HN ]