Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by fnordpiglet on Wednesday September 13, 2023 @11:56AM
(#37498418)
Yes, in fact I think at some point everyone has written their own Markov generators or at least run dissociative press. But we’ve really only seen meaningfully high quality output over the last few years.
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by radarsat1 on Thursday September 14, 2023 @10:58AM
(#37509905)
I think it depends on how you define that. People were quite happy with HMM-based MIDI generators that could generate Beethoven- or Mozart-like sequences 10, maybe even 15 or 20 years ago. But of course other people pointed out the problems of it being boring eventually. Then LSTMs improved long-term dependencies and people were impressed by the improved quality of generating whole musical pieces. But still others thought it was not good enough. Then the goalposts moved again with transformers and neural vocoders and now we want top-40 direct audio generation. And these latest systems can kind of sort of do it! But still there are people who demand better. And so on, things will continue to improve.
Progress only moves as fast as expectations, and expectations move with technology. Music is not special in this respect. So you could say at any given time in the past that some people "see meaningfully high quality" and others are disappointed. You see exactly both these sides of the spectrum even now with text-to-image and text-to-audio technology.
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by fassssst on Wednesday September 13, 2023 @01:48PM
(#37499463)
Do you know if anyone has tried training a text-to-music or text-to-midi model where the training data includes things like emotion labels for each note interval or chord progression?
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by Jeff_Brown on Wednesday September 13, 2023 @01:58PM
(#37499578)
That sounds expensive and inefficient. Peoples' interpretations of music (and abstract art more generally) can be shockingly different; I suspect the model would not get a clear signal from the result.
But that makes me wonder to what extent labeling can be programmed -- extracting chord changes, dynamics changes, tempo, gross timbral characteristics, etc.
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion
by fassssst on Wednesday September 13, 2023 @02:03PM
(#37499644)
And maybe even labels like popularity/play count/etc so it has a better sense of what “sounds good” to certain groups
Note sequence generation from statistical models has a long history, at least as long if not longer than text generation.
Have a look at section 2.1 of this survey paper [0] that cites a paper from 1957 as the first work that applies Markov models to music generation.
And, of course, plenty of follow-up work 6 decades later on GANs, LSTMs, and transformers.
[0]: https://www.researchgate.net/publication/345915209_A_Compreh...