News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by auggierose on Saturday April 15, 2023 @05:20PM (#35584644)
Just tried out the demo, finally something that runs out of the box on my iMac Pro! This old 16GB card can finally breathe some LLM air!!

There are no comments on this comment yet.