Re:Paul Graham Interviewed By David Weinberger (Pretty Inter...
by Tichy on Tuesday April 17, 2007 @09:32AM
(#13626)
I know that speech recognition probably is not quite good enough yet :-( I have another interest in this: since I am not a native english speaker, I find it often hard to understand everything that is being said in a video. English subtitles would often be helpful (especially for those videos of interviews or conference speeches etc.).
Perhaps Amazons mechanical turk could come in handy here? Would a clone of the mechanical turk specialised on movie transcripts be feasible? Or is it too special interest? (Perhaps most people either understand the words or they would prefer a translation?).
As for syncing subtitles: I don't know the details anymore, but I remember from ripping DVDs that the subtitles come simply in a text file along with the movie. So presumably something like you propose already exists.
Re:Paul Graham Interviewed By David Weinberger (Pretty Inter...
by jkush on Tuesday April 17, 2007 @09:36AM
(#13628)
Sure, that exists because the movie studios usually ship movies out with a transcription. I don't think something like this exists for run-of-the-mill type videos. In the example of the video above, if there WERE a transcript, you could use the software I propose above to provide subtitles automatically.
Re:Paul Graham Interviewed By David Weinberger (Pretty Inter...
by shiro on Tuesday April 17, 2007 @10:02AM
(#13634)
There's a service in Japan where you can associate text to a point in a video. You type text like chat while watching a video, and the text is recorded with the timestamp and played back along the video. Association is bidirectional---you can jump to certain time point in the video from the text as well. Currently most people just making fun, putting funny text on videos, but it would be quite useful to attach transcription by collaboration of audiences.
Unfortunately they only provide closed service for registered users: http://www.nicovideo.jp/ (Actually they originally used YouTube as a video source and had no access restriction. But they got so much popular that YouTube had to shut down access from their site.)
You could provide links in a transcript which when clicked take you to the part of the video in question, if you'd like to see it. You could also go the other way, and use a transcript to provide subtitles.
Any ideas on how to make this happen? My intial thought is to exploit pauses and breaks in the sound and map them to sentences, etc. Voice mapping would help too, so you could map a sentence to Paul Graham and another sentence to the interviewer.
What would be pretty cool (actually, REALLY cool now that I think about it) would be desiging a transcript markup language that could be married to a video. Has anyone done this? Why not?