News for hackers. Stuff that matters.

A comment on Universal LLM Deployment Engine with ML Compilation.

Re:Universal LLM Deployment Engine with ML Compilation by crowwork on Friday June 07, 2024 @03:18PM (#40611961)
runs on qwen2 on iphone with 26 tok/sec and a OpenAI style swift API
[ Parent | on HN ]

There are no comments on this comment yet.