News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by lxe on Saturday April 15, 2023 @07:51PM (#35585831)
Ah darn it, and here I was trying to do this with ggml and onxx.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by tantony on Sunday April 16, 2023 @04:00AM (#35588123)
The speed at which this stuff is developing makes it very hard to keep up and contribute in a meaningful way. Especially when you have a separate full time job.