Re:Lm.rs: Minimal CPU LLM inference in Rust with no dependency
by J_Shelby_J on Friday October 11, 2024 @04:22PM
(#41813346)
What do you think about implementing your gui for other rust LLM projects? I’m looking for a front end for my project: https://github.com/ShelbyJenkins/llm_client
That's only if you want to convert the model yourself, you don't need that if you use the converted weights on the author's huggingface page (in “prepared-models” table of the README).
> From the git history, it looks like the username of the person who posted this here is someone who has contributed to the project but isn't the primary author.
Yup that's correct, so far I've only authored the dioxus GUI app.
> If they could elaborate on what exactly they mean by saying this has "zero dependencies", that might be helpful.
See my other response: https://news.ycombinator.com/item?id=41812665