News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by Aardwolf on Tuesday July 18, 2023 @01:04PM (#36775767)
Will Llama 2 also work as a drop-in in existing tools like llama.cpp, or does it require different / updated tools?
Re:Llama 2 – Meta AI by swyx on Tuesday July 18, 2023 @01:41PM (#36776428)
Re:Llama 2 – Meta AI by woadwarrior01 on Tuesday July 18, 2023 @01:27PM (#36776190)
Not quite a drop in replacement, but close enough. From the paper[1]:

> Llama 2, an updated version of Llama 1, trained on a new mix of publicly available data. We also increased the size of the pretraining corpus by 40%, doubled the context length of the model, and adopted grouped-query attention (Ainslie et al., 2023)[2].

[1]: https://ai.meta.com/research/publications/llama-2-open-found...

[2]: https://arxiv.org/abs/2305.13245