My Private LLM Setup at Home, Confidentially Accessible on Mobile Posted by thethindev on Wednesday March 13, 2024 @11:18AM from the thin.computer dept. https://thin.computer/index.php/2024/03/08/my-journey-self-hosting-ollama-and-open-web-ui-to-securely-and-confidentially-access-ai/ ( 3 comments | 4 points | on HN )
I'm using llama2 and llama2-uncensored, but I'm going to download llava and mixtral later. Either way, it's been a great experience
Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?
My pleasure!
> Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?
Initially, I wasn't thinking about it but it looks easy enough [1][2]!
[1] https://iwasnothing.medium.com/llm-fine-tuning-with-macbook-...
[2] https://github.com/ml-explore