News for hackers. Stuff that matters.
Re:Llama 3.1 in C by BaculumMeumEst on Wednesday July 24, 2024 @08:48AM (#41056518)
I think generalizing llama2.c like this project is doing kind of defeats the purpose, no?
Re:Llama 3.1 in C by AMICABoard on Wednesday July 24, 2024 @10:29AM (#41057477)
Hmm yeah, it started as fork of karpathy's llama2.c and some experiments. So it is an abomination I agree.
Re:Llama 3.1 in C by zarkenfrood on Thursday July 25, 2024 @06:05AM (#41066802)
It's really interesting and a great piece of work that you have put in what looks like a huge amount of effort. You should definitely be proud of this.
Re:Llama 3.1 in C by AMICABoard on Thursday July 25, 2024 @09:01AM (#41068182)
Thank you :) The open source community is great, the core is a confluence of the awesome work of others. I'm just a orchestrator. I wish I had more time to make it into something like llama.cpp and an OS around it.