Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour...
by RhodesianHunter on Thursday April 25, 2024 @04:28PM
(#40162592)
Gods if this isn't exactly how it'll turn out.
Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour...
by hnthrowaway9812 on Saturday April 27, 2024 @05:01PM
(#40183515)
It's a wast if they are mostly all trying the SAME things. Which is mostly what is happening.
I want someone to spend a million on a Chess LLM so we can get a sense of how sophisticated they can get at non-linguistic pattern matching.
I want someone to spend a million on an LLM trained on Python program traces so we can try to teach it cause and effect and "debugging". Maybe it will emulate a Python interpreter and get highly reliable at predicting the outcome of Python code.
etc.
Furthermore, I'm happy to be in a golden age with lots of orgs trying things and many options. It's going to suck once the market eventually consolidates us and we have to take whatever enshittified thing the ologopolists feed us.