News for hackers. Stuff that matters.

A comment on Code Llama, an AI tool for coding. Parent comment

Re:Code Llama, an AI tool for coding by redox99 on Thursday August 24, 2023 @12:30PM (#37250906)
If you want to run them fast, a 12GB GPU (e.g 3060) for the 13B and a 24GB GPU for the 34B (e.g 3090). Otherwise llama.cpp CPU inference would work on most machines.
[ Parent | on HN ]

There are no comments on this comment yet.