News for hackers. Stuff that matters.

A comment on Run Llama2-70B in Web Browser with WebGPU Acceleration.

Re:Run Llama2-70B in Web Browser with WebGPU Acceleration by ruihangl on Monday July 24, 2023 @01:39PM (#36851587)
Purely running in web browser. Generating 6.2 tok/s on Apple M2 Ultra with 64GB of memory.
[ Parent | on HN ]

There are no comments on this comment yet.