News for hackers. Stuff that matters.

A comment on Snowflake Arctic Instruct (128x3B MoE), largest open source model. Parent comment

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by tosh on Wednesday April 24, 2024 @12:31PM (#40146434)
It is both cost efficient in training (+ future fine-tuning) as well as inference compared to most other current models.

Can you elaborate?

[ Parent | on HN ]
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by ru552 on Wednesday April 24, 2024 @02:54PM (#40148131)
the unquantized model is almost 1tb in size and the benchmarks provided by Snowflake shows performance in the middle of the pack compared to other recent releases.
[ Parent | on HN ]
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by rajhans on Wednesday April 24, 2024 @05:16PM (#40149770)
We have published some insights here. https://medium.com/snowflake/snowflake-arctic-cookbook-serie...
[ Parent | on HN ]