News for hackers. Stuff that matters.
Re:YouTubeTranscript.com by BasilPH on Sunday December 18, 2022 @09:37PM (#34047646)
This is cool!

We're doing forced alignment with audio recordings i.e. podcasts. Here's an example from a test client: https://www.withfanfare.com/p/seldon-crisis/search-by-the-fo...

Grateful for any feedback you might have.

Also, if you run a knowledge-dense podcast, or know somebody that does, I would love to talk to you/them. I'm for example considering to link places, people and things in a transcript.

Re:YouTubeTranscript.com by svat on Monday December 19, 2022 @01:12AM (#34049057)
Lovely, thanks for the example. I really like how the underline is subtle yet effective. The animation/effect where it seems to inch forward is also intriguing; how does that work? (Also, this is subjective but have you considered making double-clicking on the text open the audio player even when it's not been started yet? Would make it more discoverable, though I imagine some could get annoyed. Another minor thing: when the audio is paused and you double click somewhere, the audio position changes but this is not reflected in the player; only takes effect when you unpause.)

You're doing cool work, good luck with your service! It looks very useful and if someone I know is running a podcast I'll recommend it for sure; it looks really well-done and polished (at least the example you shared).

Re:YouTubeTranscript.com by BasilPH on Monday December 19, 2022 @10:18AM (#34053039)
Thank you! I wrote your points down. We're still learning how to make it most usable.

We know the start and end timestamps on a word level and we know the current player time. So all we do is set a CSS class on the words that are currently playing. We not only highlight the current word, but also the words that are close in time. This is what generates the effect.

We just released autoscroll, which is something that was requested often.

Re:YouTubeTranscript.com by marcelfahle on Monday December 19, 2022 @04:55AM (#34050318)
Wow, this looks incredible! Love how the underline travels and guides the eye.. Very impressive!

Excuse the question, but "forced alignment" is when you don't have timestamps, like in webvtt?

Re:YouTubeTranscript.com by BasilPH on Monday December 19, 2022 @10:32AM (#34053226)
Thank you!

Yes, exactly. We do forced alignment when you edit your transcript. The new words don't have any timestamps, so we need to align them. For short sections we use interpolation. If we need align whole sections we use Gentle[^1].

[^1]: https://github.com/lowerquality/gentle

Re:YouTubeTranscript.com by marcelfahle on Tuesday December 20, 2022 @09:14AM (#34066154)
Thank you, this is really interesting! :)