Meta AI releases Code Llama 70B

Re:Meta AI releases Code Llama 70B by kungfupawnda on Wednesday January 31, 2024 @08:54AM (#39203790)

Thanks, I got all but the 70b model to work. It slows to a crawl on the Mac with 36 gb ram.

[ Parent | on HN ]

Re:Meta AI releases Code Llama 70B by annjose on Wednesday January 31, 2024 @01:28PM (#39207439)

Cool. I am running this on M2 Max 64GB. Here is how it looks on my terminal [1]. Btw, the very first run after downloading the model is slightly slow, but the subsequent runs are ok.

[1] https://asciinema.org/a/fFbOEfeTxRShBGbqslwQMfJS4 Note: This recording is in real-time speed, not sped-up.

[ Parent | on HN ]

Re:Meta AI releases Code Llama 70B by kungfupawnda on Wednesday January 31, 2024 @02:22PM (#39208098)

I am returning the M3 max 36 GB and picking this model instead. Saves me a grand and it seems to be much more powerful..

[ Parent | on HN ]

Re:Meta AI releases Code Llama 70B by mkevac on Thursday February 08, 2024 @06:46AM (#39300833)

What do you mean you are returning it? It has been used already.

[ Parent | on HN ]