News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by firatsarlar on Monday April 17, 2023 @05:16AM (#35598407)
The question comes from a kind of confusion. We know the requirements of LLMs. How can we run the hardware it is currently working on, only the big LLM, with an 11Gb graphics card? I really didn't mind!

There are no comments on this comment yet.