News for hackers. Stuff that matters.

A comment on Ask HN: Is there an ML model that can go from an audio song to sheet music?.

Re:Ask HN: Is there an ML model that can go from an audio so... by tmaly on Wednesday June 07, 2023 @01:50PM (#36230520)
Ableton Live has something that can convert audio to midi.

Then there are open source programs that can convert midi to sheet music.

I have tried the process, but you tend to get artifacts in the midi from Ableton.

You have to know a little bit about music theory to clean it up.

[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by uptownfunk on Wednesday June 07, 2023 @02:02PM (#36230723)
Oh cool, do you know if this works for recordings where there are multiple instruments (clapping, organ, vocals, hand drums)
[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by jrflowers on Wednesday June 07, 2023 @02:39PM (#36231395)
I imagine that if you separated a track into its components you could extract the sheet music for each part individually. I don’t know how sheet music for clapping would work though.
[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by solarmist on Wednesday June 07, 2023 @04:10PM (#36232827)
I imagine just notes on the C line with an x plus stem like is used for basic drum rhythm notation.
[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by tmaly on Monday June 12, 2023 @03:57PM (#36300029)
It does, but it does not break them out in to tracks.
[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by Lariscus on Wednesday June 07, 2023 @10:03PM (#36236247)
Is that worth it tough? It seems to me the effort of cleaning up sheet music generated from MIDI would be higher than transcribing the whole piece by hand.
[ Parent | on HN ]
Re:Ask HN: Is there an ML model that can go from an audio so... by tmaly on Monday June 12, 2023 @03:56PM (#36300022)
It depends on how good you are at music theory.

Some people can do this cleanup really quickly.

[ Parent | on HN ]