News for hackers. Stuff that matters.
Re:Deepseek R1-0528 by rahimnathwani on Wednesday May 28, 2025 @02:44PM (#44119263)
I'm not sure that's enough RAM to run it at full precision (FP8).

This guy ran a 4-bit quantized version with 768GB RAM: https://news.ycombinator.com/item?id=42897205

There are no comments on this comment yet.