News for hackers. Stuff that matters.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by hnfong on Thursday April 25, 2024 @02:54AM (#40154316)
Very nice! This list is super convenient for LLM “connoisseurs”(?) like me.

Did you have a script to generate it or was it manually done?

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by lhl on Thursday April 25, 2024 @03:44AM (#40154636)
Just spotted this link. Just to clarify, I (not the original poster, although everyone's welcome to share this link, it's a public doc) maintain this list (and the rest of the sheet) manually. While I keep the foundation models that I'm interested in fairly up to date, obviously there are too many fine-tunes/datasets to track now. I started this when LLaMA was first released and I was getting myself up to speed on the LLM landscape.

A group at the CRFM maintains a bigger list of models (their goal is stated for cataloguing foundation models, but it looks like they have some tunes mixed in these days): https://crfm.stanford.edu/ecosystem-graphs/

This site also seems to keep track of models, with more closed/announced models that I don't bother to track: https://lifearchitect.ai/models-table/

Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by hnfong on Thursday April 25, 2024 @06:36AM (#40155734)
Very useful info. Thank you!
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour... by hnthrowaway9812 on Saturday April 27, 2024 @05:02PM (#40183526)
Thanks for this spreadsheet! It's amazing!