News for hackers. Stuff that matters.
Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by phkahler on Tuesday January 28, 2025 @08:27AM (#42852045)
>> While 192GB of ram is appealing, it's also quite expensive at $6000.

That's because it's Apple. It time to start moving to AMD systems with shared memory. My Zen 3 APU system has 64GB these days and its a mini ITX board.

Re:DeepSeek-R1 with Dynamic 1.58-bit Quantization by Maakuth on Tuesday January 28, 2025 @08:37AM (#42852134)
What is the performance in ML workloads like on AMD APUs compared to Apple Silicon?