News for hackers. Stuff that matters.

yongwww

Re:Universal LLM Deployment Engine with ML Compilation on Friday June 07, 2024 @04:04PM (#40612409)
The MLCEngine presents an approach to universal LLM deployment, glad to know it works for both local servers and cloud devices with competitive performance. Looking forward to exploring it further!
Re:Running Stable Diffusion fully in browser with WebGPU on Wednesday March 08, 2023 @03:28PM (#35074313)
Great project! It is able to run on my local Mac M2, the generated result looks good to me! Looking forward to seeing more models are enabled