News for hackers. Stuff that matters.
Re:Videogrep: Automatic Supercuts with Python by vitovito on Thursday June 19, 2014 @06:34PM (#7918645)
Word (and phoneme) level granularity is usually used for lip-synching (CG, video games) and karaoke-type applications.

If you have an accurate text transcript, but not detailed enough timings, you can use speech recognition on the audio and it will be very accurate, since you know exactly what is being said (unlike speech recognition on arbitrary speech, this is more like command-and-control). You can do word-level or phoneme-level timing granularity pairing an accurate transcript with the original audio.

The metadata isn't there in regular subtitles, but you can certainly get it there with some post-processing.

Re:Videogrep: Automatic Supercuts with Python by arafalov on Friday June 20, 2014 @04:52AM (#7919995)
Is there a good easy-to-use software/service that does that kind of alignment of accurate text transcript to audio/video?

I used to have some links but the companies went out of business.

Re:Videogrep: Automatic Supercuts with Python by vitovito on Friday June 20, 2014 @11:05PM (#7924007)
Probably not for free. I also haven't done this kind of work in over a decade. The current links I have are:

Annosoft's SDK: http://www.annosoft.com/prices

Annosoft made a command-line front-end to the Microsoft Speech API, which is what many of these other Windows-based systems may also use, and I used in a project in 1999-2001: http://www.annosoft.com/sapi_lipsync/docs/ (There are other SAPI front-ends if you dig around online, too.)

Others, including open-source ones: http://en.wikipedia.org/wiki/List_of_speech_recognition_soft...

Magpie, used in animation and gaming: http://www.thirdwishsoftware.com/magpiepro.html

Crazytalk, used in animation, uses SAPI: http://www.reallusion.com/crazytalk/crazytalk.aspx

FaceFX, used in gaming: http://www.facefx.com/documentation/2013.2/W194

Source Filmmaker includes it, although I'd be surprised if it wasn't Sphinx or SAPI or some other existing library: https://developer.valvesoftware.com/wiki/SFM/Lip-sync_animat...