News for hackers. Stuff that matters.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by theturtletalks on Wednesday April 24, 2024 @12:55PM (#40146867)
Yep, seems like every company is taking a longshot on a AI project. Even companies like Databricks (MosaicML) and Vercel (v0 and ai.sdk) are seeing if they can take a piece of this every growing pie.

Snowflake and the like are training and releasing new models because they intend to integrate the AI into their existing product down the line. Why not use and fine-tune an existing model? Their in-grown model maybe better suited for their product. This can also fail like Bloomberg's financial model being inferior to GPT-4, but these companies have to try.

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by vineyardmike on Wednesday April 24, 2024 @03:41PM (#40148678)
> Why not use and fine-tune an existing model?

Not all of them have permissive licenses for whatever the companies may want (or their clients want). Kind of a funny situation where everyone would benefit, but no one wants to burn their money for the greater good.

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by dudus on Wednesday April 24, 2024 @04:26PM (#40149151)
Their biggest competitor release a model. They must follow suit.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by newshackr on Thursday April 25, 2024 @02:35PM (#40161333)
It isn't like they could have started this after the release and been done by now.