News for hackers. Stuff that matters.

A comment on Run Mistral 7B on M1 Mac.

Re:Run Mistral 7B on M1 Mac by vaillant on Saturday December 16, 2023 @11:09PM (#38670246)
Trivial to run Mistral 7B on an M1 Macbook Air using LM Studio. Just make sure you use a quantized version.
[ Parent | on HN ]
Re:Run Mistral 7B on M1 Mac by ekianjo on Sunday December 17, 2023 @01:15AM (#38670754)
Trivial to run it from command line with llama.cpp

Takes 5 minutes really.

[ Parent | on HN ]