News for hackers. Stuff that matters.

A comment on Self-Hosting Open Source LLMs: Cross Devices and Local Deployment of Mistral 7B. Parent comment

Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by jokethrowaway on Tuesday November 21, 2023 @09:20AM (#38363939)
Excellent at creative writing

Pretty good at instructions

Uncensored, no RHLF bs

[ Parent | on HN ]
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by ashupadhi01 on Tuesday November 21, 2023 @10:02AM (#38364518)
Tell me how can I run it locally.
[ Parent | on HN ]
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by youngNed on Tuesday November 21, 2023 @10:54AM (#38365351)
Ashu, i am going to guess that english is not your first language, apologies, if that is not the case, but " Tell me how can I run it locally." is not a great way to ask for info, not here at least. A 'please' would certainly help, but a less direct way might be even better.

Anyway, to answer your question: https://ollama.ai/

[ Parent | on HN ]