News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by mark_l_watson on Tuesday July 18, 2023 @04:39PM (#36778763)
Thank you, that looks useful! I don’t have much RAM on either of my Macs (I usually use Colab or Lambda Labs GPS VPSs to run LLMs). It would be great to add a column on your model display for RAM size to run the models.
Re:Llama 2 – Meta AI by jmorgan on Tuesday July 18, 2023 @04:44PM (#36778818)
That's a great idea! Will do.

Generally, a 7B model requires at least a Mac with 16GB of shared memory. In practice I see it using about 6GB of RAM when loaded.