jinhongyii
LLM Microserving: a new RISC-style approach to design LLM serving API
Re:Scaling LLama2-70B with Multi Nvidia/AMD GPU
on Thursday October 19, 2023 @08:57PM (#37950924)
The performance is really amazing with such low cost.
Re:Running Stable Diffusion fully in browser with WebGPU
on Wednesday March 08, 2023 @02:14PM (#35073435)
Great work! It's exciting to see such a large model running on my local web browser.