Re:
by pogue on Tuesday February 25, 2025 @12:36AM
(#43168549)
I think it would also be helpful if it could pronounce or vocalize specific words you click on to learn the definition of, if not entirely transcribe the subtitled text in another language.
Re:
by umlx on Tuesday February 25, 2025 @01:11AM
(#43168747)
Thanks for the feedback!
It is possible to use an external dictionary tool to speak via the clipboard, but it seems difficult to support many languages.
It would be easy to implement using Microsoft UWP speech API, but there may be quality issues.
I will research if there is a good quality playback method locally, Thanks.
Re:
by umlx on Tuesday February 25, 2025 @05:40AM
(#43170248)
Thanks, For translating, currently it translates one subtitle at a time, so the accuracy is low because it cannot retain the context before and after the subtitle.
I'm addressing this by supporting dual subtitles. Translation is assumed to be used only as a complement.
I would like to improve accuracy by preserving context, but I haven't found a good way to do this at the moment.
If we are talking about the accuracy of the transcription, it is very good if you use a large model.
At least the accuracy of whisper is far superior to Youtube's subtitle generation!
Re:
by umlx on Tuesday February 25, 2025 @07:05AM
(#43170856)
It's not open source, but PotPlayer supported it in December before VLC's announcement, so I'm not the first.
Incidentally, I added this feature in October.
I will imitate the good points of other players with ASR implementation.
Re:
by sebnun on Tuesday February 25, 2025 @11:02AM
(#43173598)
Looks really nice congrats, I built something similar but for podcasts [0]
I see you are using yt-dlp for YouTube, my app originally also played YouTube videos scraped with yt-dlp, but I found that it is very hard to get YouTube audio "at scale" even when rotating IP, using proxies, etc. You will eventually get blocked, so I dropped the whole thing and focused on podcasts.
But with your app the user runs it locally so that shouldn't be a problem. Good luck.
Keep up the good work, cool idea.
I will research if there is a good quality playback method locally, Thanks.
I would like to improve accuracy by preserving context, but I haven't found a good way to do this at the moment.
If we are talking about the accuracy of the transcription, it is very good if you use a large model. At least the accuracy of whisper is far superior to Youtube's subtitle generation!
I will imitate the good points of other players with ASR implementation.
I see you are using yt-dlp for YouTube, my app originally also played YouTube videos scraped with yt-dlp, but I found that it is very hard to get YouTube audio "at scale" even when rotating IP, using proxies, etc. You will eventually get blocked, so I dropped the whole thing and focused on podcasts.
But with your app the user runs it locally so that shouldn't be a problem. Good luck.
[0] https://www.langturbo.com