News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by junrushao1994 on Sunday April 16, 2023 @03:13AM (#35587952)
Would be nice if anyone could help us benchmark! Our primary focus though is not model performance, but to demonstrate the capability that TVM Unity generates code targeting WebGPU and allows them to run with client GPUs :-)

There are no comments on this comment yet.