Re:OpenAI says it has evidence China's DeepSeek used its mod...
by esafak on Wednesday January 29, 2025 @03:39PM
(#42870849)
The latest models create information from base models by randomly creating candidate responses then pruning the bad ones using an evaluation function. The good responses improve the model.
It is not distillation. It's like how you can arrive at new knowledge by reflecting on existing knowledge.
It is not distillation. It's like how you can arrive at new knowledge by reflecting on existing knowledge.