Running Dolly 2.0 on Paperspace

Re:Running Dolly 2.0 on Paperspace by Irishsteve on Thursday April 13, 2023 @02:34AM (#35551854)

Could just be timing. Dolly was announced yesterday - Llama was announced by FB and then it took perhaps a week or two weeks for Llama.cpp to appear.

[ Parent | on HN ]

Re:Running Dolly 2.0 on Paperspace by iruoy on Thursday April 13, 2023 @05:24AM (#35552970)

Will Llama.cpp give the same results as Llama? And how is it so much easier to run?

[ Parent | on HN ]

Re:Running Dolly 2.0 on Paperspace by naasking on Thursday April 13, 2023 @11:43AM (#35557195)

Llama.cpp is just a redistributable C++ program. The original Llama depended on a Python machine learning toolchain IIRC, so a lot more dependencies to install.

[ Parent | on HN ]