News for hackers. Stuff that matters.
Re:PyTorch – Torchchat: Chat with LLMs Everywhere by sunshinesfbay on Thursday August 01, 2024 @06:28PM (#41134293)
Pretty cool! What are the steps to use these on mobile? Stoked about using ollama on my iPhone!
Re:PyTorch – Torchchat: Chat with LLMs Everywhere by dagaci on Friday August 02, 2024 @02:00AM (#41136463)
>> "If running windows" << All of these have web interfaces actually, and all of these implement the same openai api.

So you get to browse locally and remotely if you are able to expose the service remotely adjusting your router.

Coudflare will also expose services remotely if you wishhttps://developers.cloudflare.com/cloudflare-one/connections...

So you can also run on any LLM privately with ollama, lmstudio, and or LLamaSharp with windows, mac and iphone, all are opensource and customizable too and user friendly and frequently maintained.