Re:DeepSeek proves the future of LLMs is open-source
by jampekka on Wednesday January 29, 2025 @11:51AM
(#42867516)
The model itself yes. The changes from previous architectures are often quite small code-wise. Quite often just adding/changing few lines in a torch model.
Things like tweaking all the hyperparameters to make the training process actually work may be more tricky though.
Things like tweaking all the hyperparameters to make the training process actually work may be more tricky though.