News for hackers. Stuff that matters.

A comment on Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Language Model, from MetaAI. Parent comment

Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by azinman2 on Thursday January 25, 2024 @02:40AM (#39127200)
I assume this doesn’t yet run on llama.cpp?
[ Parent | on HN ]
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by lhl on Thursday January 25, 2024 @04:17AM (#39127689)
here are some GGUFs https://huggingface.co/brittlewis12/Snorkel-Mistral-PairRM-D...
[ Parent | on HN ]
Re:Lucidrains/self-rewarding-lm-PyTorch: Self-Rewarding Lang... by tarruda on Thursday January 25, 2024 @03:54AM (#39127568)
It is based on Mistral which llama.cpp supports, so I assume it does run (you might need to convert to GGUF format and quantize it).
[ Parent | on HN ]