Re:Web LLM – WebGPU Powered Inference of Large Language Models
by firatsarlar on Monday April 17, 2023 @05:16AM
(#35598407)
The question comes from a kind of confusion. We know the requirements of LLMs. How can we run the hardware it is currently working on, only the big LLM, with an 11Gb graphics card? I really didn't mind!
[ Parent
| on HN ]
There are no comments on this comment yet.