News for hackers. Stuff that matters.

A comment on Many options for running Mistral models in your terminal using LLM. Parent comment

Re:Many options for running Mistral models in your terminal ... by ls612 on Monday December 18, 2023 @11:17PM (#38691749)
Will the Mixtral 8x7 run well on a 64GB M2 Max then?
[ Parent | on HN ]
Re:Many options for running Mistral models in your terminal ... by simonw on Tuesday December 19, 2023 @12:16AM (#38692116)
I'm using an M2 64GB and Mixtral works pretty well.
[ Parent | on HN ]
Re:Many options for running Mistral models in your terminal ... by ls612 on Tuesday December 19, 2023 @10:41PM (#38705194)
It’s wild my laptop can run AI models better than my RTX 4090 desktop. Thanks for the info!
[ Parent | on HN ]