Re:Tencent Hunyuan-Large
by ronsor on Tuesday November 05, 2024 @06:49PM
(#42056238)
The AI training algorithms are deterministic given the same dataset, same model architecture, and same set of hyperparameters. The main reasons the models would not be identical is due to differing random seeds and precision issues. The differences would not be due to any creative decisions.
[ Parent
| on HN ]
Re:Tencent Hunyuan-Large
by margalabargala on Wednesday November 06, 2024 @12:00PM
(#42065303)
Sure, but they don't all use the same algorithm, the same hyperparameters, etc.
At some point, with sufficiently many hyperparameters being chosen, that starts becoming a creative decision. If 5 parameters are available and all are left at the default, then no, that's not creative. If there are ten thousand, and all are individually tweaked to yield what the user wants, is that creative?
Not to mention all of these companies write their own algorithms to do the training which can introduce other small differences.