News for hackers. Stuff that matters.
Re:In-browser LLM inference engine with WebGPU and OpenAI API by ruihangl on Thursday June 13, 2024 @03:44PM (#40673761)
It's good to see that it contains the standard OpenAI API interface in JavaScript which looks very convenient.
[ Parent | on HN ]
Re:In-browser LLM inference engine with WebGPU and OpenAI API by crowwork on Thursday June 13, 2024 @03:30PM (#40673596)
Comes with ability to do full structured generation with json schema

also a in-browser demo https://chat.webllm.ai/

[ Parent | on HN ]
Re:In-browser LLM inference engine with WebGPU and OpenAI API by cyx6 on Thursday June 13, 2024 @06:25PM (#40675535)
AMAZING!
[ Parent | on HN ]
Re:In-browser LLM inference engine with WebGPU and OpenAI API by leshenj15 on Thursday June 13, 2024 @06:30PM (#40675581)
So cool. No more privacy concerns!
[ Parent | on HN ]