News for hackers. Stuff that matters.

A comment on Show HN: Steiner – An open-source reasoning model inspired by OpenAI o1. Parent comment

Re:Show HN: Steiner – An open-source reasoning model inspire... by peakji on Tuesday October 22, 2024 @03:18PM (#41917682)
GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf

I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?

[ Parent | on HN ]
Re:Show HN: Steiner – An open-source reasoning model inspire... by ca_tech on Wednesday October 23, 2024 @09:35AM (#41924937)
You can now run any huggingface model using the following command

ollama run hf.co/{username}/{repository}

Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M

Source: https://huggingface.co/docs/hub/en/ollama

[ Parent | on HN ]