spectrometerHBH
spectrometerHBH on Hacker News
Re:MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100
on Thursday July 20, 2023 @02:06PM (#36804319)
Memory is all you need, and MLC!
7B version is available in AppStore for iPhones and iPads: https://t.co/NLqe9mypgB
And I confirm it's also runnable on my M1 Pro MBP
Re:Running Stable Diffusion fully in browser with WebGPU
on Wednesday March 08, 2023 @02:04PM (#35073324)
50s per image, 16'' M1 pro 16G mbp, amazing!