News for hackers. Stuff that matters.

A comment on DeepSeek: X2 Speed for WASM with SIMD. Parent comment

Re:DeepSeek: X2 Speed for WASM with SIMD by Philpax on Tuesday January 28, 2025 @09:06PM (#42860666)
llama.cpp optimises for hackability, not necessarily maintainability or cleanliness. You can look around the repository to get a feel for what I mean.
[ Parent | on HN ]
Re:DeepSeek: X2 Speed for WASM with SIMD by almostgotcaught on Tuesday January 28, 2025 @09:37PM (#42860855)
i guess that means no one should use it for anything serious? good to know
[ Parent | on HN ]
Re:DeepSeek: X2 Speed for WASM with SIMD by Philpax on Tuesday January 28, 2025 @09:43PM (#42860892)
To some extent, yes. I would not run production off of it, even if it can eek out performance gains on hardware at hand. I'd suggest vLLM or TGI or something similar instead.
[ Parent | on HN ]