Re:RedPajama (Open LLaMA Replication) 3B and 7B models released
by azinman2 on Saturday May 06, 2023 @04:29AM
(#35839365)
Do these red pajama models work with llama.cpp?
[ Parent
| on HN ]
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released
by Joeri on Saturday May 06, 2023 @05:51AM
(#35839785)
No, llama.cpp only works with llama-based models, like base llama, alpaca, vicuna, ...
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released
by anentropic on Saturday May 06, 2023 @07:01AM
(#35840142)
the naming is confusing... these models are aiming to equal or beat LLaMa by reproducing the trainign data and methodology that was used for LLaMa
But the actual model architecture is slightly different, based on Pythia
I guess what is needed is a pythia.cpp https://github.com/ggerganov/llama.cpp/issues/742
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released
by anentropic on Wednesday May 10, 2023 @08:46AM
(#35886520)