News for hackers. Stuff that matters.
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion by fassssst on Wednesday September 13, 2023 @01:48PM (#37499463)
Do you know if anyone has tried training a text-to-music or text-to-midi model where the training data includes things like emotion labels for each note interval or chord progression?
Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion by Jeff_Brown on Wednesday September 13, 2023 @01:58PM (#37499578)
That sounds expensive and inefficient. Peoples' interpretations of music (and abstract art more generally) can be shockingly different; I suspect the model would not get a clear signal from the result.

But that makes me wonder to what extent labeling can be programmed -- extracting chord changes, dynamics changes, tempo, gross timbral characteristics, etc.

Re:Stable Audio: Fast Timing-Conditioned Latent Audio Diffusion by fassssst on Wednesday September 13, 2023 @02:03PM (#37499644)
And maybe even labels like popularity/play count/etc so it has a better sense of what “sounds good” to certain groups