DeepSeek proves the future of LLMs is open-source

Re:DeepSeek proves the future of LLMs is open-source by deepsquirrelnet on Wednesday January 29, 2025 @11:16AM (#42866867)

At least a TB of VRAM to load it in fp16. They distilled to smaller models, which do not perform as well, but can be run on a single GPU. Full R1 is big though.

[ Parent | on HN ]

Re:DeepSeek proves the future of LLMs is open-source by nickthegreek on Thursday January 30, 2025 @11:14AM (#42879157)

fp16? I thought it was trained at fp8.

[ Parent | on HN ]