Re:M2 Ultra can run 128 streams of Llama 2 7B in parallel
by sonthonax on Thursday October 12, 2023 @05:34AM
(#37855098)
I've noticed that M series Macs have extremely fast disk drives that the OS uses as swap quite efficiently. I've frequently used all my RAM on my Mac and barely noticed any slowdown when it starts swapping.
[ Parent
| on HN ]