Show HN: Cloning a musical instrument from 16 seconds of audio

Re:Show HN: Cloning a musical instrument from 16 seconds of ... by tgv on Saturday February 26, 2022 @03:46AM (#30476153)

Bit late to the action, but do I understand correctly that this trains a harmonic synthesizer? That would explain why the reverb in "How does the amount of training data affect synthesis fidelity?" sounds a bit off, as it would get synthesized on unrelated input.

But what I wanted to ask: is the final model actually understandable or visualizable, e.g. as an envelope per harmonic that depends on F0, loudness and F0 confidence?

Anyway, I'm impressed.

[ Parent | on HN ]

Re:Show HN: Cloning a musical instrument from 16 seconds of ... by abdljasser2 on Saturday February 26, 2022 @04:16AM (#30476270)

I can't say for sure but I think the issue with why the reverb sounds off in that particular example is that the reverb present in the recording has a longer decay than the maximum reverb duration I set for the experiments (1s). I will set it longer in the future.

Yes, that kind of visualisation could be performed. The authors of the prior work we are building on (DDSP) have made some great visualisations which I think you will find useful! Here: https://storage.googleapis.com/ddsp/index.html

[ Parent | on HN ]