News for hackers. Stuff that matters.
Re:Extracting Chinese Hard Subs from a Video, Part 1 by wolfgang42 on Monday May 29, 2017 @05:32PM (#14441563)
One possible extension of this is to erase the original subtitles using something like gimp-resynthesizer's Heal Selection, and then replace them with translated ones, all automatically. (I've redrawn the video frame from the post[1] so you can see what I mean.)

[1]: https://static.linestarve.com/ext/ycombinator-news/itm144408...

Re:Extracting Chinese Hard Subs from a Video, Part 1 by phire on Monday May 29, 2017 @05:55PM (#14441693)
Using a 2d image resynthesis algorithm is sub-optimal for video. There is basically no chance of it picking the same result every single frame, you will see a flickering shadow of weirdness where the old characters were.

You have lots of infomation of what image should be there; You have motion vectors signaling when an object or background has moved into (or out of) a blocked area. Or a maybe the motion vectors indicate object/background is stationary and you can use infomation from before/after the subtitles to fill it in.

I'm not aware of such a 3d video resynthesis algorithm existing, but it should be possible.

Re:Extracting Chinese Hard Subs from a Video, Part 1 by sorenjan on Monday May 29, 2017 @06:31PM (#14441855)
It's called video inpainting. I'm not familiar with it, but here's one paper with video examples I found: http://perso.telecom-paristech.fr/~gousseau/video_inpainting...
Re:Extracting Chinese Hard Subs from a Video, Part 1 by ec109685 on Tuesday May 30, 2017 @03:07AM (#14443404)
Google Translate is able to do this if you point it at live video.