Yeah, thats an interesting use-case. For now its just merging the SDXL images using ffmpeg and adding narration. For intro videos it would need cooler transitions. Maybe in the next version.
Re:
by ashmil on Friday September 29, 2023 @11:33PM
(#37712581)
The tool shows promise and it's really fast. I generated a video transcript and the narration was good. However, some images were contextually incorrect or seemed like half-baked AI-generated images.
This will be much better if the following can be done
- Issues with image generation
- Add some transition
- option to add an avatar like https://www.synthesia.io
- add a custom intro and outro
Thanks for the feedback. Added those to the backlog. Unfortunately this app has pushed Streamlit to its limits. It works as intended as a MVP, but the next version architecture will be more scalable.
In [.-_] the hyphen makes it so it matches chars between . and _. It needs to be rewritten with the hyphen at the end so it doesn't treat it as that: [._-]
- OpenAI Instruct API for generating script
- SDXL model for generating images
- ElevenLabs API for narration
- Streamlit for hosting and UI
Example “Some stunning facts about the universe” https://topic2clip.streamlit.app/?vid=7549e327-89f3-478d-9dc...
In [.-_] the hyphen makes it so it matches chars between . and _. It needs to be rewritten with the hyphen at the end so it doesn't treat it as that: [._-]