News for hackers. Stuff that matters.

A comment on Stable-Audio-Demo. Parent comment

Re:Stable-Audio-Demo by gcanko on Tuesday February 13, 2024 @12:36PM (#39360266)
I think it would be ideal if it could take the audio recording of humming or singing a melody together with a text prompt and spitting out a track that resembles it
[ Parent | on HN ]
Re:Stable-Audio-Demo by yogorenapan on Tuesday February 13, 2024 @06:12PM (#39364172)
1. Do your humming and pass it to something like Stable Audio with ControlNet

2. Convert/average the tone for each beat to generate something resembling a music sheet

3. Use vocaloid with LLM generated lyrics based on your prompt (or just put in your lyrics) and pass in the music file

4. Combine the 1-3

Would love to see this

[ Parent | on HN ]