Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour...
by vineyardmike on Wednesday April 24, 2024 @03:41PM
(#40148678)
> Why not use and fine-tune an existing model?
Not all of them have permissive licenses for whatever the companies may want (or their clients want). Kind of a funny situation where everyone would benefit, but no one wants to burn their money for the greater good.
Snowflake and the like are training and releasing new models because they intend to integrate the AI into their existing product down the line. Why not use and fine-tune an existing model? Their in-grown model maybe better suited for their product. This can also fail like Bloomberg's financial model being inferior to GPT-4, but these companies have to try.