Re:My 2.5 year old laptop can write Space Invaders in JavaSc...
by nxobject on Wednesday July 30, 2025 @07:14AM
(#44732817)
My very cursory understanding -- at least from Unsloth's recommendations -- is that you have to work very hard to preserve reasoning/instruct capabilities [1]: for example to "preserve" Qwen3's reasoning capabilities (however that's operationalized), they suggest a fine-tuning corpus that's 75% chain of thought to 25% non-reasoning. Is that a significant issue for orgs/projects that currently rely on fine-tuning?
[1] https://docs.unsloth.ai/basics/qwen3-how-to-run-and-fine-tun...