Re:DeepSeek proves the future of LLMs is open-source
by nexus_six on Wednesday January 29, 2025 @11:23AM
(#42866990)
For people who have the disciplinary background in neural networks and machine learning I imagine that replicating that paper into some type of framework would be straight forward right? Or am I mistaken?
[ Parent
| on HN ]
Re:DeepSeek proves the future of LLMs is open-source
by jampekka on Wednesday January 29, 2025 @11:51AM
(#42867516)
The model itself yes. The changes from previous architectures are often quite small code-wise. Quite often just adding/changing few lines in a torch model.
Things like tweaking all the hyperparameters to make the training process actually work may be more tricky though.