Re:Continue with LocalAI: An alternative to GitHub's Copilot...
by hcrisp on Monday August 28, 2023 @01:42PM
(#37297763)
Ollama only works on Mac. Here is a portable option:
Re:Continue with LocalAI: An alternative to GitHub's Copilot...
by mchiang on Monday August 28, 2023 @01:45PM
(#37297804)
People have been compiling Ollama to run on Linux. The reason why it's not packaged yet for Linux is due to packaging it with GPU support - at the very least with nvidia support.
Almost there!
Continue also works with various backends and fine-tuned versions of Code Llama. E.g. for a local experience with GPU acceleration on macOS, continue can be used with Ollama (https://github.com/jmorganca/ollama):