Re:Quantized Llama models with increased speed and a reduced...
by evbogue on Thursday October 24, 2024 @07:32PM
(#41940878)
I'm on Android, however my somewhat elaborate solution was to install Ollama on my home laptop computer and then ssh in when I want to query a model. I figured that'd be better for my phone battery. Since my home computer is behind NAT I run yggdrasil on everything so I can access my AI on the go.
[ Parent
| on HN ]
There are no comments on this comment yet.