News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by gpm on Monday June 02, 2025 @06:46PM (#44164064)
I've been using small local LLMs for translation recently (<=7GB total vram usage) and they, even the small ones, definitely beat Google Translate in my experience. And they don't require sharing whatever I'm reading with Google, which is nice.
Re:My AI skeptic friends are all nuts by yubblegum on Monday June 02, 2025 @06:52PM (#44164136)
What are you using? whisper?
Re:My AI skeptic friends are all nuts by gpm on Monday June 02, 2025 @06:57PM (#44164177)
Edit: Huh, didn't know whisper could translate.

Just whatever small LLM I have installed as the default for the `llm` command line tool at the time. Currently that's gemma3:4b-it-q8_0 though it's generally been some version of llama in the past. And then this fish shell function (basically a bash alias)

    function trans
        llm "Translate \"$argv\" from French to English please"
    end
Re:My AI skeptic friends are all nuts by codethief on Monday June 02, 2025 @07:50PM (#44164636)
> Uh, translation, not transcription

Whisper can translate to English (and maybe other languages these days?), too.