Re:A comprehensive guide to running Llama 2 locally
by abhibeckert on Tuesday July 25, 2023 @10:34PM
(#36872462)
This. The main system memory on a Mac Studio is GPU memory and there's a lot of it.
It also has the Neural Engine, which is specifically designed for this type of work - most software isn't designed to take advantage of that yet, but presumably it will soon.
It also has the Neural Engine, which is specifically designed for this type of work - most software isn't designed to take advantage of that yet, but presumably it will soon.