News for hackers. Stuff that matters.
Re:Are transformer models production-ready? Not quite by odessamama on Wednesday November 02, 2022 @07:34AM (#33434116)
The fundamental architectures of transformers haven't changed in years. I wonder what kind of design changes will be made in the future and how that impacts these results.
Re:Are transformer models production-ready? Not quite by mklond on Wednesday November 02, 2022 @07:29AM (#33434083)
Transformers seem great. IMO the big challenge is still to better understand how they perform in operation.
Re:Are transformer models production-ready? Not quite by saladtoes on Wednesday November 02, 2022 @08:05AM (#33434360)
Interesting, thanks for sharing! Somehow I'm not surprised. My experience building systems for real world applications is that choosing a simple CNN is usually the way to go, and it's all in the data. Choosing more complex model classes also comes at a cost, higher variance and more likelihood of issues related to robustness and generalization.
Re:Are transformer models production-ready? Not quite by bukhailo on Wednesday November 02, 2022 @08:15AM (#33434483)
Interesting, but what about the more recent YOLO versions? Do you have any research on if they encounter the same issues?