Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Llama 2 – Meta AI. Parent comment
Generally, a 7B model requires at least a Mac with 16GB of shared memory. In practice I see it using about 6GB of RAM when loaded.
There are no comments on this comment yet.
Generally, a 7B model requires at least a Mac with 16GB of shared memory. In practice I see it using about 6GB of RAM when loaded.