News for hackers. Stuff that matters.
Re:MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of ... by spectrometerHBH on Thursday July 20, 2023 @02:06PM (#36804319)
Memory is all you need, and MLC!

7B version is available in AppStore for iPhones and iPads: https://t.co/NLqe9mypgB

And I confirm it's also runnable on my M1 Pro MBP

There are no comments on this comment yet.