News for hackers. Stuff that matters.
Re:Quantized Llama models with increased speed and a reduced... by evbogue on Thursday October 24, 2024 @07:32PM (#41940878)
I'm on Android, however my somewhat elaborate solution was to install Ollama on my home laptop computer and then ssh in when I want to query a model. I figured that'd be better for my phone battery. Since my home computer is behind NAT I run yggdrasil on everything so I can access my AI on the go.

There are no comments on this comment yet.