Re:Snowflake Arctic Instruct (128x3B MoE), largest open sour...
by furyofantares on Wednesday April 24, 2024 @03:15PM
(#40148345)
There's no perfect analogy. It's far easier to usefully modify the weights of a model without the training data than it is to modify a binary executable without its source code.
I'd rather also have the data for sure! But in terms of what useful things I can do with it, weights are closer to source code than they are to a binary blob.
I'd rather also have the data for sure! But in terms of what useful things I can do with it, weights are closer to source code than they are to a binary blob.