News for hackers. Stuff that matters.
Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by sonthonax on Thursday October 12, 2023 @05:34AM (#37855098)
I've noticed that M series Macs have extremely fast disk drives that the OS uses as swap quite efficiently. I've frequently used all my RAM on my Mac and barely noticed any slowdown when it starts swapping.
Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel by detourdog on Thursday October 12, 2023 @08:55AM (#37856518)
I found that SSD drives finally eliminated the drawbacks of Mach's VM. While on platter drives one needed lots of RAM to avoid needing to swap.