News for hackers. Stuff that matters.
Re:I've created a simple web game to help learn chords and b... by swyx on Saturday December 14, 2024 @07:02PM (#42420402)
okay, but.. any path to connecting this to phone mics so that it can function anywhere? whats the state of the art in tone and chord recognition models?
Re:I've created a simple web game to help learn chords and b... by jasinjames on Saturday December 14, 2024 @07:30PM (#42420514)
No need for any ML models here, you can "just" do an FFT on a conventional signal and pick out the peaks
Re:I've created a simple web game to help learn chords and b... by swyx on Sunday December 15, 2024 @02:42AM (#42422144)
(i mean yes i agree but) so ... why do i feel like ive never seen anyone do this before?
Re:I've created a simple web game to help learn chords and b... by criddell on Sunday December 15, 2024 @12:41PM (#42424713)
I believe this is how Yousician works.
Re:I've created a simple web game to help learn chords and b... by udit99 on Monday December 23, 2024 @03:27PM (#42497331)
If you have a guitar handy, you can try out the live mode on https://www.fretboardfly.com . It works and people use it: Using your acoustic guitar to play the fretboard learning game via the mic.
Re:I've created a simple web game to help learn chords and b... by codyd51 on Sunday December 15, 2024 @05:16AM (#42422652)
The waveform produced by sounding a note on most physical instruments will often not exhibit a peak, or will not exhibit the strongest peak, on the note being sounded. Rather, most instruments will instead produce harmonic overtones and our brains fill in the gap of the pitch that’s intended to be sounded.

You can still absolutely deduce the fundamental with great accuracy via an FFT, but the approach is a bit more involved. The relevant research area here is called ‘fundamental frequency estimation’.

For an example of this, you can see this app I built that lets you give keyboard and mouse inputs via playing notes on a bass guitar, which are recognized over the microphone: https://github.com/codyd51/offkeyboard