News for hackers. Stuff that matters.
Re:Deepseek R1-0528 by otabdeveloper4 on Thursday May 29, 2025 @01:39AM (#44123417)
You can fine-tune their weights and release your own take.

E.g. see all the specialized third-party models out there based on Qwen.

"Open-source" is the wrong word here, what they mean is "you can modify and redistribute these weights".

Re:Deepseek R1-0528 by yetihehe on Thursday May 29, 2025 @02:44AM (#44123659)
You can also reverse engineer and modify closed source programs (see mods for games). Weights are like compiled version of source data.
Re:Deepseek R1-0528 by macrolime on Thursday May 29, 2025 @03:20AM (#44123797)
Not legally. That's the difference.
Re:Deepseek R1-0528 by timschmidt on Thursday May 29, 2025 @03:22AM (#44123803)
Sure you can. It's often legally protected activity. You're just limited to distributing your modifications without the original work.
Re:Deepseek R1-0528 by macrolime on Thursday May 29, 2025 @01:00PM (#44127942)
For some games maybe, but software often has a clause forbidding reverse engineering
Re:Deepseek R1-0528 by timschmidt on Thursday May 29, 2025 @04:19PM (#44129926)
ChatGPT says that such clauses are typically void in the EU, though they may apply in some cases in the US. Even in the US, the triennial DMCA rule-making has granted broader exemptions for good-faith security research every cycle since 2016.

https://chatgpt.com/share/6838c070-705c-8005-9a88-83c9a5550a...

Re:Deepseek R1-0528 by otabdeveloper4 on Thursday May 29, 2025 @05:21AM (#44124341)
Finetuning isn't reverse engineering. Finetuning is a standard supported workflow for these models.

Also, the "redistribute" part is key here.

Re:Deepseek R1-0528 by yetihehe on Thursday May 29, 2025 @06:16AM (#44124587)
> Finetuning isn't reverse engineering

Fully agree, it isn't. Reverse engineering isn't necessary for modifying compiled program behaviour, so comparing it to finetuning is not applicable. Finetuning applied to program domain would be more like adding plugins or patching in some compiled routines. Reverse-engineering applied to models would be like extracting source documents from weights.

> Finetuning is a standard supported workflow for these models.

Yes, so is adding mods for some games, just put your files in a designated folder and game automatically picks it up and does required modifications.

> Also, the "redistribute" part is key here.

It is not. Redistributability and being open source is orthogonal. You can have a source for a program and not be able to redistribute source or program, or you can redistribute a compiled program, but not have it's source (freeware).