A brief history of LLaMA models

Re:A brief history of LLaMA models by KETpXDDzR on Saturday April 29, 2023 @06:32PM (#35757903)

llama.cpp was easy to setup IMO

[ Parent | on HN ]

Re:A brief history of LLaMA models by jiggawatts on Sunday April 30, 2023 @02:01AM (#35760031)

Can you link to a working Dockerfile?

I've heard several people say that it is easy, but then surely it ought to be trivial to set script the build so that it works reliable in a container!

[ Parent | on HN ]

Re:A brief history of LLaMA models by PostOnce on Sunday April 30, 2023 @03:09AM (#35760302)

No need to drag a gigabyte of docker stuff into this, just extract the zip file from github and type make into your terminal

congratulations, it now works.

If you're not a developer, maybe you'll have to type sudo apt install build-essential first. Congratulations, now you too, a non-developer, are running it locally.

https://github.com/ggerganov/llama.cpp

[ Parent | on HN ]

Re:A brief history of LLaMA models by vidarh on Sunday April 30, 2023 @08:12AM (#35761845)

Did that, got a compiler error within seconds within seconds. Looks like it might need a newer version of gcc than is in the distro on my laptop. Which is why people ask for Docker. If it really will work just with make with build-essential on a new enough distro image, a Dockerfile that documents that would be trivial, and does not at all stop people from just typing make if their setup is new enough.

[ Parent | on HN ]

Re:A brief history of LLaMA models by kolinko on Sunday April 30, 2023 @05:28AM (#35760990)

but what for?

[ Parent | on HN ]