News for hackers. Stuff that matters.

A comment on Do vision transformers see like convolutional neural networks?. Parent comment

Re:Do vision transformers see like convolutional neural netw... by dexter89_kp3 on Wednesday August 25, 2021 @12:43PM (#28303785)
They do. Karpathy spoke about it in on Tesla AI day. They use it for transforming image space to a vector space.

See: https://youtu.be/j0z4FweCy4M (timestamp 54.40 onwards)

[ Parent | on HN ]
Re:Do vision transformers see like convolutional neural netw... by sillysaurusx on Wednesday August 25, 2021 @12:50PM (#28303872)
Can you provide a more specific timestamp? 54.40 doesn't seem to mention anything about transformers, and "onwards" is two hours.

I'd be really surprised if they use transformers due to how computationally expensive they are for anything involving vision.

EDIT: Found it. 1h: https://www.youtube.com/watch?v=j0z4FweCy4M?t=1h

Fascinating. I guess transformers are efficient.

[ Parent | on HN ]
Re:Do vision transformers see like convolutional neural netw... by dexter89_kp3 on Wednesday August 25, 2021 @01:55PM (#28304653)
I gave the timestamp where they start talking about the problem they are trying to solve using transformers. As you said it is around 1hr mark
[ Parent | on HN ]