News for hackers. Stuff that matters.
Re:whisper.api: An open source, self-hosted speech-to-text w... by LeoPanthera on Tuesday August 22, 2023 @04:30PM (#37228152)
So is "real time" translation a thing yet? I've long wanted to be able watch non-english television and have the audio translated into English subtitles. It's doable for pre-recorded things, but not for live.

An iPhone app that could do this from the microphone would also be amazing. Google Translate and it's various competitors from Microsoft/Apple are nearly there, but they all stop listening inbetween sentences. Something that just listened constantly, printing translated text onto the screen, would be amazing.

Re:whisper.api: An open source, self-hosted speech-to-text w... by innovatorved on Tuesday August 22, 2023 @04:38PM (#37228201)
Just wait for a couple of weeks. I am working on speech-to-speech translation. Instead of subtitles, you can listen to it directly. I am also working on subtitles.
Re:whisper.api: An open source, self-hosted speech-to-text w... by LeoPanthera on Tuesday August 22, 2023 @04:51PM (#37228342)
But I don't want that. I just want a live stream of translated text.
Re:whisper.api: An open source, self-hosted speech-to-text w... by xigency on Tuesday August 22, 2023 @04:52PM (#37228358)
You can do this with PowerPoint actually. I bumped something once and Japanese subtitles popped up following what I was saying in my confusion.
Re:whisper.api: An open source, self-hosted speech-to-text w... by videogreg93 on Tuesday August 22, 2023 @04:53PM (#37228379)
I've been using the Microsoft Speech api for an app and so far it's been surprisingly very good for realtime speech to text.
Re:whisper.api: An open source, self-hosted speech-to-text w... by DarthNebo on Tuesday August 22, 2023 @09:42PM (#37230876)
For long running stuff https://developer.apple.com/tutorials/app-dev-training/trans... should be straightforward to translate as well using ported on-device BERT models