News for hackers. Stuff that matters.

A comment on Do vision transformers see like convolutional neural networks?. Parent comment

Re:Do vision transformers see like convolutional neural netw... by sillysaurusx on Wednesday August 25, 2021 @12:26PM (#28303617)
It may make sense, but it also makes no sense. CNNs already have full view of the entire input image. That's how discriminators are able to discriminate in GANs.

We added attention and observed no benefits at all in our GAN experiments.

[ Parent | on HN ]

There are no comments on this comment yet.