News for hackers. Stuff that matters.

A comment on Ask HN: Recommendations for Local LLMs in 2024: Private and Offline?. Parent comment

Re:Ask HN: Recommendations for Local LLMs in 2024: Private a... by FezzikTheGiant on Monday April 08, 2024 @07:10PM (#39974643)
So I can run local LLMs on my apple M1 air?
[ Parent | on HN ]
Re:Ask HN: Recommendations for Local LLMs in 2024: Private a... by tharmas on Tuesday April 09, 2024 @02:17PM (#39982396)
Yes you can. Download LM studio and then search for a model such as Mistral-7B-Instruct-v0.2. LM studio will suggest variants of that model that suit your hardware to download. Here's a demonstration: https://www.youtube.com/watch?v=VXHryjPu52k
[ Parent | on HN ]