Re:Google: Transforming the Future of Music Creation
by earthnail on Thursday November 16, 2023 @04:58AM
(#38287597)
When you sing into Riffusion, it just puts time constraints on the lyrics. Example:
"I've never seen a diamond in the flesh" from Lorde, sung into Riffusion:
"I've:0.72-0.96 never:0.96-1.20 seen:1.20-1.48 a:1.48-1.64 diamond:1.64-2.32 in:2.32-2.76 the:2.76-3.02 flesh:3.02-3.86"
With the timestamps being second-annotations. The Google model takes the whole melody and phrasing as input as well.
"I've never seen a diamond in the flesh" from Lorde, sung into Riffusion: "I've:0.72-0.96 never:0.96-1.20 seen:1.20-1.48 a:1.48-1.64 diamond:1.64-2.32 in:2.32-2.76 the:2.76-3.02 flesh:3.02-3.86"
With the timestamps being second-annotations. The Google model takes the whole melody and phrasing as input as well.