News for hackers. Stuff that matters.
Re:Mistral 7B, the most powerful language model for its size... by nacs on Thursday September 28, 2023 @07:21PM (#37697259)
Outlines looks like an actively maintained alternative to Guidance. Do you have any plans to support llama.cpp?
Re:Mistral 7B, the most powerful language model for its size... by btwillard on Wednesday October 04, 2023 @01:02AM (#37761020)
We've considered it, but I haven't started any work on it. Feel free to create an issue to track the status, if only to find out who else might be interested and/or working on it.