News for hackers. Stuff that matters.
Re:Continue with LocalAI: An alternative to GitHub's Copilot... by jmorgan on Monday August 28, 2023 @12:46PM (#37296957)
Continue has a great guide on using the new Code Llama model launched by Facebook last week: https://continue.dev/docs/walkthroughs/codellama

Continue also works with various backends and fine-tuned versions of Code Llama. E.g. for a local experience with GPU acceleration on macOS, continue can be used with Ollama (https://github.com/jmorganca/ollama):

  ollama pull codellama

  from continuedev.src.continuedev.libs.llm.ollama import Ollama

  config = ContinueConfig(
    models=Models(
      default=Ollama(model="wizardcoder:34b-python")
    )
  )
Re:Continue with LocalAI: An alternative to GitHub's Copilot... by hcrisp on Monday August 28, 2023 @01:42PM (#37297763)
Ollama only works on Mac. Here is a portable option:

https://github.com/xnul/code-llama-for-vscode

Re:Continue with LocalAI: An alternative to GitHub's Copilot... by mchiang on Monday August 28, 2023 @01:45PM (#37297804)
People have been compiling Ollama to run on Linux. The reason why it's not packaged yet for Linux is due to packaging it with GPU support - at the very least with nvidia support.

Almost there!