News for hackers. Stuff that matters.
Re:DeepSeek proves the future of LLMs is open-source by zelphirkalt on Thursday January 30, 2025 @05:48AM (#42876622)
So, as you state yourself basically, the result also depends on training data, which makes it part of the "compiled source" in a way, just like the architecture of the model. If you have the training data, you can modify that.

But probably it is impossible for them to release the training data, as they have probably not made it all reproducible, but live ingested the data, and the data has since then chanced in many places. So the code to live ingest the data becomes the actual source, I guess.

There are no comments on this comment yet.