News for hackers. Stuff that matters.
Re:Running Dolly 2.0 on Paperspace by iruoy on Thursday April 13, 2023 @05:24AM (#35552970)
Will Llama.cpp give the same results as Llama? And how is it so much easier to run?
Re:Running Dolly 2.0 on Paperspace by naasking on Thursday April 13, 2023 @11:43AM (#35557195)
Llama.cpp is just a redistributable C++ program. The original Llama depended on a Python machine learning toolchain IIRC, so a lot more dependencies to install.