Re:DeepSeek releases Janus Pro, a text-to-image generator [pdf]
by Onawa on Monday January 27, 2025 @04:48PM
(#42846054)
Deepseek R1 is the closest thing we have to fully open-source currently. Open enough that Huggingface is recreating R1 completely out in the open. https://github.com/huggingface/open-r1
Re:DeepSeek releases Janus Pro, a text-to-image generator [pdf]
by blackeyeblitzar on Monday January 27, 2025 @07:39PM
(#42847602)
What they’re recreating is the evidence that some of the techniques work. But they’re starting with R1 as the input into those steps, not starting from scratch. I don’t think their work includes creating a base model.
Re:DeepSeek releases Janus Pro, a text-to-image generator [pdf]
by serjester on Monday January 27, 2025 @08:37PM
(#42847955)
The fundamental problem is that AI depends on massive amounts of IP theft. I’m not going to argue if that’s right or wrong, but without it we won’t even have open weights models.
Open source means we need to be able to reproduce what they’ve built - which means transparency on the training data, training source code, evaluation suites, etc. For example, what AI2 does with their OLMo model:
https://allenai.org/blog/olmo2