News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by slowmotiony on Monday April 01, 2024 @04:05AM (#39891794)
I use a tool called LM Studio, makes it trivial to run these models on a Mac. You can also use it as a local API so it kinda acts like a drop-in replacement for the openAI API.

There are no comments on this comment yet.