News for hackers. Stuff that matters.
Re:Riffusion – Stable Diffusion fine-tuned to generate Music by leod on Thursday December 15, 2022 @04:54PM (#34006349)
Awesome work.

Would you be willing to share details about the fine-tuning procedure, such as the initialization, learning rate schedule, batch size, etc.? I'd love to learn more.

Background: I've been playing around with generating image sequences from sliding windows of audio. The idea roughly works, but the model training gets stuck due to the difficulty of the task.

There are no comments on this comment yet.