News for hackers. Stuff that matters.

A comment on Llm.c – LLM training in simple, pure C/CUDA. Parent comment

Re:Llm.c – LLM training in simple, pure C/CUDA by r-k-jo on Thursday April 11, 2024 @02:00AM (#39998846)
You can also target WASM. Depending on the model size, it can be really good. Here are some examples of quantized models.

Vision Model https://huggingface.co/spaces/radames/Candle-Moondream-2 Blip Image Captioning https://huggingface.co/spaces/radames/Candle-BLIP-Image-Capt... Microsoft Phi 2 https://huggingface.co/spaces/radames/Candle-phi1-phi2-wasm-...

[ Parent | on HN ]

There are no comments on this comment yet.