News for hackers. Stuff that matters.
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by smcleod on Tuesday November 21, 2023 @07:19AM (#38362646)
It seems a lot slower than ollama / LM Studio. Is that likely because it’s not optimised as much or a limitation of some sort?

There are no comments on this comment yet.