Re:Llama3 running locally on iPhone 15 Pro
by dTal on Tuesday April 23, 2024 @08:38AM
(#40131254)
On Android you can simply run vanilla llama.cpp inside a terminal, or indeed any stack that you would run on a Linux desktop that doesn't involve a native GUI.
[ Parent
| on HN ]
Re:Llama3 running locally on iPhone 15 Pro
by iAkashPaul on Tuesday April 23, 2024 @09:09AM
(#40131540)
Yep, termux is a good way to do this. Llama.cpp has Android example as well, I forked it here GitHub.com/iakashpaul/portal you can try it with any supported GGUF/Q4+Q8 models