Re:Llama 2 – Meta AI
by Aardwolf on Tuesday July 18, 2023 @01:04PM
(#36775767)
Will Llama 2 also work as a drop-in in existing tools like llama.cpp, or does it require different / updated tools?
[ Parent
| on HN ]
some adaptation needed https://github.com/ggerganov/llama.cpp/issues/2262
Re:Llama 2 – Meta AI
by woadwarrior01 on Tuesday July 18, 2023 @01:27PM
(#36776190)
Not quite a drop in replacement, but close enough.
From the paper[1]:
> Llama 2, an updated version of Llama 1, trained on a new mix of publicly available data. We also increased the size of the pretraining corpus by 40%, doubled the context length of the model, and adopted grouped-query attention (Ainslie et al., 2023)[2].
[1]: https://ai.meta.com/research/publications/llama-2-open-found...