News for hackers. Stuff that matters.

A comment on In-browser LLM inference engine with WebGPU and OpenAI API.

Re:In-browser LLM inference engine with WebGPU and OpenAI API by crowwork on Thursday June 13, 2024 @03:30PM (#40673596)
Comes with ability to do full structured generation with json schema

also a in-browser demo https://chat.webllm.ai/

[ Parent | on HN ]

There are no comments on this comment yet.