thethindev

Re: on Thursday March 21, 2024 @02:56PM (#39782880)

I setup this web server on Android with just Termux!

Re:My Private LLM Setup at Home, Confidentially Accessible on Mobile on Wednesday March 13, 2024 @11:36AM (#39692638)

> This is exactly the type of setup I'm interested on replicating on my end. Thanks a lot for the post!!

My pleasure!

> Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?

Initially, I wasn't thinking about it but it looks easy enough [1][2]!

Re:My Private LLM Setup at Home, Confidentially Accessible on Mobile on Wednesday March 13, 2024 @11:19AM (#39692338)

I setup a simple homelab on a macbook air and added ollama + open webui. Now I have an LLM I can talk to whenever I'm out.

I'm using llama2 and llama2-uncensored, but I'm going to download llava and mixtral later. Either way, it's been a great experience

My Private LLM Setup at Home, Confidentially Accessible on Mobile

Posted by thethindev on Wednesday March 13, 2024 @11:18AM
from the thin.computer dept.

( Read More... | 3 comments | 4 points | on HN )

Re:Own Your Web – Issue 11: Welcome to the IndieWeb on Wednesday March 13, 2024 @11:15AM (#39692271)

There's an online meetup for people in PST [1] scheduled for tonight. I didn't RSVP but I hope to be able to attend so I can show my home lab.

Posted by thethindev on Tuesday March 12, 2024 @04:59PM
from the thin.computer dept.

( Read More... | no comments | on HN )

Re:Home Lab Beginners guide on Friday March 08, 2024 @10:33AM (#39641965)

I actually did just that and setup my homelab with my "old" laptop [1].