News for hackers. Stuff that matters.
Re:A comprehensive guide to running Llama 2 locally by abhibeckert on Tuesday July 25, 2023 @10:34PM (#36872462)
This. The main system memory on a Mac Studio is GPU memory and there's a lot of it.

It also has the Neural Engine, which is specifically designed for this type of work - most software isn't designed to take advantage of that yet, but presumably it will soon.

There are no comments on this comment yet.