News for hackers. Stuff that matters.
Re:A comprehensive guide to running Llama 2 locally by novaRom on Tuesday July 25, 2023 @04:28PM (#36868898)
16Gb is minimum to run 7B model with float16 weights; out of the box, with no further efforts.

There are no comments on this comment yet.