News for hackers. Stuff that matters.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by blackeyeblitzar on Wednesday April 24, 2024 @03:53PM (#40148805)
> What's the rationale for releasing all these models to the public? Do all these tech companies know something we don't? Why are they doing this?

It’s mostly marketing for the company to appear to be modern. If you aren’t differentiated and if LLMs aren’t core to your business model, then there’s no loss from releasing weights. In other cases it is commoditizing something that would otherwise be valuable for competitors. But most of those 600K models aren’t high performers and don’t have large training budgets, and aren’t part of the “race”.

There are no comments on this comment yet.