Re:Videogrep: Automatic Supercuts with Python
by Osmium on Thursday June 19, 2014 @04:37PM
(#7918162)
Very cool. What's the current best tool to help make the .srt file? e.g. the current best-of-breed text recognition / text alignment tool. Last time I looked at something like this there didn't seem to be a particularly robust solution, especially for text alignment.
Re:Videogrep: Automatic Supercuts with Python
by saaaam on Thursday June 19, 2014 @04:57PM
(#7918259)
Hello! Original author here. I'm not sure about the best tool for creating new .srt files, but for films, you can find pretty much anything on opensubtitles.org or subscene.com (although the quality varies). You can also download .srts for youtube videos (again, quality varies).
Re:Videogrep: Automatic Supercuts with Python
by isomorphic on Thursday June 19, 2014 @08:33PM
(#7919016)
I will caution people that downloaded subs are very often misaligned (timing) with your video, due to various cuts of videos, intro logos, disc versions, framerates, etc., etc. Leave your download page open and check one-by-one against the source video.
Re:Videogrep: Automatic Supercuts with Python
by Spittie on Thursday June 19, 2014 @05:51PM
(#7918495)
I think Aegisub (http://www.aegisub.org/) is the current golden standard in the anime community, which is one of the most active when it comes to subtitles.
Re:Videogrep: Automatic Supercuts with Python
by jbaiter on Thursday June 19, 2014 @04:43PM
(#7918183)
Last time I did this (~2011} "Subtitle Editor"[1] was a pretty decent solution for *nix-based systems.
On Windows, VisualSubSync[2] was all the rage, iirc.
Re:Videogrep: Automatic Supercuts with Python
by nsxwolf on Thursday June 19, 2014 @05:53PM
(#7918506)
I wanted to do exactly this, but I wanted to do it at a word level granularity. So that you could input any text and get a video of random clips from many sources each saying exactly the words in the input string.
Re:Videogrep: Automatic Supercuts with Python
by vitovito on Thursday June 19, 2014 @06:34PM
(#7918645)
Word (and phoneme) level granularity is usually used for lip-synching (CG, video games) and karaoke-type applications.
If you have an accurate text transcript, but not detailed enough timings, you can use speech recognition on the audio and it will be very accurate, since you know exactly what is being said (unlike speech recognition on arbitrary speech, this is more like command-and-control). You can do word-level or phoneme-level timing granularity pairing an accurate transcript with the original audio.
The metadata isn't there in regular subtitles, but you can certainly get it there with some post-processing.
Annosoft made a command-line front-end to the Microsoft Speech API, which is what many of these other Windows-based systems may also use, and I used in a project in 1999-2001: http://www.annosoft.com/sapi_lipsync/docs/ (There are other SAPI front-ends if you dig around online, too.)
Re:Videogrep: Automatic Supercuts with Python
by gerbal on Thursday June 19, 2014 @06:27PM
(#7918619)
You could get a gigantic bunch of film & television subtitles. Almost every movie ever made and every TV show in the past 30 years has pretty good subtitles available from a variety of online sources.
Using common Python NLP techniques you could very easily search for every instance of a phrase across a massive corpora of subtitles.
If you got a large enough collection of subtitles and videos in a single directory this tool would do what you are asking.
Re:Videogrep: Automatic Supercuts with Python
by wtracy on Thursday June 19, 2014 @10:20PM
(#7919259)
How about a program that automatically finds, say, the smallest number of segments that covers all of the input words? At least then the program would do a lot of the heavy lifting for you, and you could do the last bit of cleanup manually.
Re:Videogrep: Automatic Supercuts with Python
by tdicola on Thursday June 19, 2014 @06:07PM
(#7918554)
Nice tool, also I had no idea about the moviepy library used by the tool. Looks like a really nice little library for making small video edits in python. Cool!
Re:Videogrep: Automatic Supercuts with Python
by chatmasta on Friday June 20, 2014 @01:33AM
(#7919629)
I remember reading a while back that employees at big news networks (think Fox, CNBC, CNN, etc.) had access to some massive database of broadcast videos, and tooling built around the database to do exactly this. I can't find the source at the moment, but if anyone knows it, a link could be relevant.
Re:Videogrep: Automatic Supercuts with Python
by manish_gill on Thursday June 19, 2014 @11:49PM
(#7919459)
One thing that annoys me with subtitles is that when they even have all the sound effects. [SCREAMS LOUDLY], [OMINOUS MUSIC PLAYS] etc. So something like the Total Recall silence thing probably won't work to a great degree of accuracy in those cases.
Re:Videogrep: Automatic Supercuts with Python
by rmc on Friday June 20, 2014 @05:57AM
(#7920110)
Those are for people who are deaf.
Some places call this "closed captioning" (i.e. deaf target audience), versus "subtitles" (target audience is people who can hear, but not understand the language).
Re:Videogrep: Automatic Supercuts with Python
by rjtavares on Friday June 20, 2014 @02:59AM
(#7919778)
Solution: use foreign language subtitles (since the goal is translation and not helping with hearing impaired people, those effects aren't usually included).
[1] http://home.gna.org/subtitleeditor/ [2] http://www.visualsubsync.org/
https://code.google.com/p/subler/
...although its OCR engine (Tesseract) can be a little sketchy.
I don't think the metadata is quite there yet.
If you have an accurate text transcript, but not detailed enough timings, you can use speech recognition on the audio and it will be very accurate, since you know exactly what is being said (unlike speech recognition on arbitrary speech, this is more like command-and-control). You can do word-level or phoneme-level timing granularity pairing an accurate transcript with the original audio.
The metadata isn't there in regular subtitles, but you can certainly get it there with some post-processing.
I used to have some links but the companies went out of business.
Annosoft's SDK: http://www.annosoft.com/prices
Annosoft made a command-line front-end to the Microsoft Speech API, which is what many of these other Windows-based systems may also use, and I used in a project in 1999-2001: http://www.annosoft.com/sapi_lipsync/docs/ (There are other SAPI front-ends if you dig around online, too.)
Others, including open-source ones: http://en.wikipedia.org/wiki/List_of_speech_recognition_soft...
Magpie, used in animation and gaming: http://www.thirdwishsoftware.com/magpiepro.html
Crazytalk, used in animation, uses SAPI: http://www.reallusion.com/crazytalk/crazytalk.aspx
FaceFX, used in gaming: http://www.facefx.com/documentation/2013.2/W194
Source Filmmaker includes it, although I'd be surprised if it wasn't Sphinx or SAPI or some other existing library: https://developer.valvesoftware.com/wiki/SFM/Lip-sync_animat...
Using common Python NLP techniques you could very easily search for every instance of a phrase across a massive corpora of subtitles.
If you got a large enough collection of subtitles and videos in a single directory this tool would do what you are asking.
Lets you search video/audio for spoken words.
http://video.bobdylan.com/desktop.html
Some places call this "closed captioning" (i.e. deaf target audience), versus "subtitles" (target audience is people who can hear, but not understand the language).
please somebody make an automatic rap impersonation generator
can make use of karaoke youtube clips for the background music...
https://en.wikipedia.org/wiki/Jay_Carney