News for hackers. Stuff that matters.
Re:How to run an LLM on your PC, not in the cloud, in less t... by jackdawipper on Monday June 24, 2024 @12:14PM (#40777853)
ollama. download a few models. bobs your uncle. simple as.

better still you can the use python to call it with langchain chatollama and build anything you want with a little help from claude and chatgpt or codeqwen if you want to do it all locally.

absolute AI don. impress the ladies with that one, you'll be beating them off with a stick when they see it in action.

just need plenty of VRAM after that.

There are no comments on this comment yet.