Llama-Cpp-WASM - Hackdot

Re:Llama-Cpp-WASM by mtasic on Tuesday February 13, 2024 @03:21PM (#39362349)

We are proud to launch our game-changing llama-cpp-wasm engine, a breakthrough in-browser LLM engine that executes on the edge using general purpose computing based on llama.cpp.

Desktop browser version is OK. Mobile browser version is WIP.

[ Parent | on HN ]

Re:Llama-Cpp-WASM by adastra22 on Tuesday February 13, 2024 @03:36PM (#39362498)

Does it use webgpu?

[ Parent | on HN ]

Re:Llama-Cpp-WASM by mtasic on Tuesday February 13, 2024 @03:39PM (#39362530)

Nope, it is just Wasm/JS. Please test it on desktop Firefox multi-threading version since it turns out to be the fastest one.

[ Parent | on HN ]