News for hackers. Stuff that matters.
Re:Ask HN: How to get started with local language models? by leopoldj on Sunday March 17, 2024 @09:23AM (#39734327)
I wrote a series of blog post precisely for someone in your situation. I hope you find them useful.

Easiest way to run a local LLM these days is Ollama. You don't need PyTorch or even Python installed.

https://mobiarch.wordpress.com/2024/02/19/run-rag-locally-us...

Hugging Face can be confusing but in the end a very well designed framework.

https://mobiarch.wordpress.com/2024/03/02/start-using-mistra...

There are no comments on this comment yet.