News for hackers. Stuff that matters.
Re:Synthia-7B-v1.3 hits 64.85 on 4-evals; LLaMA-2-70B-Chat a... by sgolem on Friday September 29, 2023 @08:03AM (#37702570)
Can this be run with llama.cpp?
Re:Synthia-7B-v1.3 hits 64.85 on 4-evals; LLaMA-2-70B-Chat a... by JackRumford on Friday September 29, 2023 @10:22AM (#37704712)
yep. this guy keeps up to date with quantised models: https://huggingface.co/TheBloke