Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by jncfhnb on Wednesday September 13, 2023 @09:49AM
(#37496714)
I feel like music composition is a fundamentally hard task for AI. Music production seems like it should be a lot easier but I haven’t seen that
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by viraptor on Wednesday September 13, 2023 @10:19AM
(#37497106)
From what I've seen in the generated tracks so far (this one and others), they're pretty good locally, but just ignore the overall composition. For example any generated blues tracks will have the vague blues feel, but won't keep the 12 bar style. The bluegrass example here doesn't even seem to keep to 4/4 (or is extremely fluid about it...). Maybe one day someone will add a higher level "what's the current section, how far are you into it" inputs to that model to get something better - literally preparing the structure first and then filling it in. That should get much better results for context like "you're playing blues in A with quick change and generating bars 3-4, match the previous bars in style".
I mean, chatgpt knows how to plan this out https://chat.openai.com/share/976077c0-138b-4363-8065-3c8eed... Painting in that picture should be much easier than generating something freeflowing. Generating a good structure isn't that hard for most styles, because you can literally use the same pattern and do a few random changes that keep the key. (See lots of pop songs using the same 3/4 chord progression)
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by Jeff_Brown on Wednesday September 13, 2023 @01:52PM
(#37499505)
Yes, and surprisingly so. I never would have guessed we'd have AI stock photographs before AI muzak.
Kudos to stability.ai for achieving this as I am sure it took a lot of effort and this is a huge leap forward in terms of generation of audio by generative AI.
However as a musician (BMus and MMus at 2 different conservatoires) I think it's important to say that the job risk being experienced by creative writers will not be extending to musicians... yet.