Re:Riffusion – Stable Diffusion fine-tuned to generate Music
by hyperbovine on Thursday December 15, 2022 @11:48AM
(#34002230)
Even if you remove the artifact, the exact same comment applies. It generates a somewhat less interesting version of elevator music. This is not to crap on what they did. As I said, they underlying problem is extremely difficult and nobody has managed to solve it.
I don't feel strongly about this topic at all.
Re:Riffusion – Stable Diffusion fine-tuned to generate Music
by indigochill on Thursday December 15, 2022 @12:20PM
(#34002707)
> It generates a somewhat less interesting version of elevator music.
This iteration does, but that's an artifact of how it's being generated: small spectograms that mutate without emotional direction (by which I mean we expect things like chord changes and intervals in melodies that we associate with emotional expressions - elevator music also stays in the neutral zone by design).
I expect with some further work, someone could add a layer on top of this that could translate emotional expressions into harmonic and melodic direction for the spectrogram generator. But maybe that would also require more training to get the spectrogram generator to reliably produce results that followed those directions?
> For every stunning example that gets passed around the internet, thousands of others sucked.
From personal experience this is simply untrue. I don't want to debate it because you seem to have strong feelings about the topic.