Re:New Mac Mini with M4
by sangnoir on Tuesday October 29, 2024 @01:58PM
(#41987481)
Which regular desktop tasks are kneecapped by 80GBps memory bandwidth?
[ Parent
| on HN ]
If local LLMs become mainstream then you want as much memory bandwidth as possible. For regular home and office use two channels of DDR4 is more than enough.
You really start taking into account bandwidth when you need 64GB or more (which is rarelly).
If it's audio/video, spawning VMs, it doesn't matter much. If it's for generative software, it might become an issue.
Unironically, small LLMs