Re:A comprehensive guide to running Llama 2 locally
by novaRom on Tuesday July 25, 2023 @04:28PM
(#36868898)
16Gb is minimum to run 7B model with float16 weights; out of the box, with no further efforts.
[ Parent
| on HN ]
There are no comments on this comment yet.