News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by Patrick_Devine on Tuesday July 18, 2023 @04:55PM (#36778941)
They're stored in a registry (based on Docker distribution) running on Cloudflare. The model gets broken up into layers, so if you want to create new prompts or parameters, you can create something called a Modelfile (similar to a Dockerfile) and just point it at the existing model.

If you want to create a new Modelfile, you can create something like:

  FROM llama2
  PARAMETER temperature 0.4
  PROMPT """

  <<Your prompt>>
  """
And then:

  ollama create <tag> -f <Modelfile>
  ollama run <tag>

There are no comments on this comment yet.