givenkiban1
Re:Ask HN: What stack to use for LLM on my local Mac?
on Sunday March 17, 2024 @02:43AM (#39732424)
Use ollama to manage and download models locally.
there's a python ollama module that can allow you to run inference with these models.
that's the first part.