News for hackers. Stuff that matters.

A comment on Web LLM – WebGPU Powered Inference of Large Language Models. Parent comment

Re:Web LLM – WebGPU Powered Inference of Large Language Models by imranq on Sunday April 16, 2023 @01:11AM (#35587457)
There are plenty of LLM benchmarks that are used to test performance, some of them are: * Winogrande

* BoolQ

* PIQA

* SIQA

* HellaSwag

etc...

[ Parent | on HN ]
Re:Web LLM – WebGPU Powered Inference of Large Language Models by junrushao1994 on Sunday April 16, 2023 @03:13AM (#35587952)
Would be nice if anyone could help us benchmark! Our primary focus though is not model performance, but to demonstrate the capability that TVM Unity generates code targeting WebGPU and allows them to run with client GPUs :-)
[ Parent | on HN ]