News for hackers. Stuff that matters.
Re:DeepSeek proves the future of LLMs is open-source by jampekka on Wednesday January 29, 2025 @11:51AM (#42867516)
The model itself yes. The changes from previous architectures are often quite small code-wise. Quite often just adding/changing few lines in a torch model.

Things like tweaking all the hyperparameters to make the training process actually work may be more tricky though.

There are no comments on this comment yet.