Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on The Transformer Family. Parent comment
Vision transformers outperform CNNs in HUGE data regimes. On small datasets, CNNs still shine.
Also, if you take a CNN with modern tricks, they can be on par with vision transformers, e.g convnext
Transformers really dominate when you scale the amount of data to infinity
Vision transformers outperform CNNs in HUGE data regimes. On small datasets, CNNs still shine.
Also, if you take a CNN with modern tricks, they can be on par with vision transformers, e.g convnext
Transformers really dominate when you scale the amount of data to infinity