Re:My AI skeptic friends are all nuts
by gpm on Monday June 02, 2025 @06:46PM
(#44164064)
I've been using small local LLMs for translation recently (<=7GB total vram usage) and they, even the small ones, definitely beat Google Translate in my experience. And they don't require sharing whatever I'm reading with Google, which is nice.
[ Parent
| on HN ]
What are you using? whisper?
Edit: Huh, didn't know whisper could translate.
Just whatever small LLM I have installed as the default for the `llm` command line tool at the time. Currently that's gemma3:4b-it-q8_0 though it's generally been some version of llama in the past. And then this fish shell function (basically a bash alias)
function trans
llm "Translate \"$argv\" from French to English please"
end