News for hackers. Stuff that matters.

A comment on Show HN: Cloning a musical instrument from 16 seconds of audio. Parent comment

Re:Show HN: Cloning a musical instrument from 16 seconds of ... by willis936 on Friday February 25, 2022 @04:55PM (#30472821)
The task I gave myself was to subtract out the drum beat (the song graciously gives the isolated loop before the instrument comes in), then mix/baseband the instrument to whatever frequency I wanted. If all went well I would make a complex FIR filter that I would pass tones into.

This model assumes the timbre is independent of the tone, but I can see now that this assumption is quite wrong and something more complicated (like this ML modeling) would be needed.

[ Parent | on HN ]
Re:Show HN: Cloning a musical instrument from 16 seconds of ... by malka on Friday February 25, 2022 @07:25PM (#30474108)
https://www.steinberg.net/fr/spectralayers/

This might help you?

[ Parent | on HN ]
Re:Show HN: Cloning a musical instrument from 16 seconds of ... by squeaky-clean on Saturday February 26, 2022 @12:39AM (#30475436)
That synth is extremely distorted post summing of the voices. (That whole album has so much distortion, it's lovely).

So not only is timbre not independent of frequency, summing multiple notes is also non-linear. The "beating" this causes is most obvious on the second chord to play. This beating is not consistent as the notes change, it's based on the difference in frequencies between the two notes being played.

[ Parent | on HN ]
Re:Show HN: Cloning a musical instrument from 16 seconds of ... by pizza on Saturday February 26, 2022 @12:50AM (#30475465)
Maybe 2nd-order spectral relationships would get you a bit closer, e.g. bispectrum / bicepstrum
[ Parent | on HN ]