News for hackers. Stuff that matters.
Re:DeepSeek-R1 by int_19h on Tuesday January 21, 2025 @08:22PM (#42787552)
Right, so Mistral accidentally released one internal prototype that was fine-tuned LLaMA. How does it follow from there that their other models are the same? Given that the weights are open, we can look, and nope, it's not the same. They don't even use the same vocabulary!

And I have no idea what you mean by "they just pick the dataset". The LLaMA training set is not publicly available - it's open weights, not open source (i.e. not reproducible).

There are no comments on this comment yet.