Re:Are transformer models production-ready? Not quite
by odessamama on Wednesday November 02, 2022 @07:34AM
(#33434116)
The fundamental architectures of transformers haven't changed in years. I wonder what kind of design changes will be made in the future and how that impacts these results.
Re:Are transformer models production-ready? Not quite
by saladtoes on Wednesday November 02, 2022 @08:05AM
(#33434360)
Interesting, thanks for sharing! Somehow I'm not surprised. My experience building systems for real world applications is that choosing a simple CNN is usually the way to go, and it's all in the data. Choosing more complex model classes also comes at a cost, higher variance and more likelihood of issues related to robustness and generalization.