Re:The End of AI Frontiers
by Brystephor on Saturday November 07, 2026 @06:09PM
(#50408930)
Im at a company with its own set of machine learning engineers, a few separate organizations internally have them so probably a few hundred MLEs in total.
More and more, the talk of using generative models (e.g. transformers) is coming up to replace existing models in all concepts. Anything from understanding data, image recognition, labeling, ranking, etc.
As someone who is not an MLE and really doesnt understand these models well, it seems like the transformer approach is a "one size fits all" solution that may not be optimal for all problem categories but is good enough that its not worth investing in specialized models to get incremental improvements.
Re:The End of AI Frontiers
by TomJansen on Saturday November 07, 2026 @07:03PM
(#50409233)
Isn't the thing with transformers is that they work really well, but only if you have a lot of training data? If data is sparse, you need more specialized models
More and more, the talk of using generative models (e.g. transformers) is coming up to replace existing models in all concepts. Anything from understanding data, image recognition, labeling, ranking, etc.
As someone who is not an MLE and really doesnt understand these models well, it seems like the transformer approach is a "one size fits all" solution that may not be optimal for all problem categories but is good enough that its not worth investing in specialized models to get incremental improvements.