News for hackers. Stuff that matters.
Re:Tencent Hunyuan-Large by margalabargala on Tuesday November 05, 2024 @05:37PM (#42055803)
> AI models are literally just facts.

Are they, or are they collections of probabilities? If they are probabilities, and those probabilities change from model to model, that seems like they might be copywritable.

If Google, OpenAI, Facebook, and Anthropic each train a model from scratch on an identical training corpus, they would wind up with four different models that had four differing sets of weights, because they digest and process the same input corpus differently.

That indicates to me that they are not a collection of facts.

Re:Tencent Hunyuan-Large by ronsor on Tuesday November 05, 2024 @06:49PM (#42056238)
The AI training algorithms are deterministic given the same dataset, same model architecture, and same set of hyperparameters. The main reasons the models would not be identical is due to differing random seeds and precision issues. The differences would not be due to any creative decisions.
Re:Tencent Hunyuan-Large by margalabargala on Wednesday November 06, 2024 @12:00PM (#42065303)
Sure, but they don't all use the same algorithm, the same hyperparameters, etc.

At some point, with sufficiently many hyperparameters being chosen, that starts becoming a creative decision. If 5 parameters are available and all are left at the default, then no, that's not creative. If there are ten thousand, and all are individually tweaked to yield what the user wants, is that creative?

Not to mention all of these companies write their own algorithms to do the training which can introduce other small differences.