Re:GuitarPie: Electric Guitar Fretboard Pie Menus
by DonHopkins on Monday September 15, 2025 @10:45AM
(#45250329)
GuitarPie: Using the Fretboard of an Electric Guitar for Audio-Based Pie Menu Interaction
ACM UIST 2025
Frank Heyen, Marius Labudda, Michael Sedlmair, Andreas Fender
Nowadays, electric guitars are often used together with digital interfaces. For instance, tablature applications can support guitar practice by rendering and playing back the tabs of individual instrument tracks of a song (guitar, drums, etc.). However, those interfaces are typically controlled via mouse and keyboard or via touch input. This means that controlling and configuring playback during practice can lead to high switching costs, as learners often need to switch between playing and interface control. In this paper, we explore the use of audio input from an unmodified electric guitar to enable interface control without letting go of the guitar. We present GuitarPie, an audio-based pie menu interaction method. GuitarPie utilizes the grid-like structure of a fretboard to spatially represent audio-controlled operations, avoiding the need to memorize note sequences. Furthermore, we implemented TabCtrl, a tablature interface that uses GuitarPie and other audio-based interaction methods for interface control.
Re:GuitarPie: Electric Guitar Fretboard Pie Menus
by DonHopkins on Monday September 15, 2025 @07:58PM
(#45256403)
Also this funky citation:
Markus Funk, Vanessa Tobisch, and Adam Emfield. 2020. Non-Verbal Auditory
Input for Controlling Binary, Discrete, and Continuous Input in Automotive
User Interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in
Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing
Machinery, 1–13. https://doi.org/10.1145/3313831.3376816
Re:GuitarPie: Electric Guitar Fretboard Pie Menus
by sublinear on Tuesday September 16, 2025 @09:00AM
(#45261631)
This is cool, but I'm having a hard time seeing this working in a real product.
Guitarists have been using their picking hand or pedal controls since the beginning of the electric guitar without much fuss or concern.
I also thought pie menus died off because everyone decided they were too limited, hard to understand, and overall annoying regardless of the input method.
Re:GuitarPie: Electric Guitar Fretboard Pie Menus
by DonHopkins on Tuesday September 16, 2025 @01:46PM
(#45265425)
Ha ha, you must not be aware of graphics tools like Blender, Maya, Rhino, Krita, SolidWorks, etc, or games like The Sims, Secret of Mana, Neverwinter Nights, Crysis, Mass Effect, Battlefield, etc.
"Hard to understand" is on you, buddy.
I wasn't aware that "everyone" got together and agreed on everything -- that seems like a suspicious claim. Where did you read that? Surely you can cite some papers and article by "everyone" as evidence, and you're just not making it up in an attempt to troll.
Keyboard and voice navigation, analog "voystick" vocal joystick formant/pitch tracking:
Voystick:
https://github.com/elisaoh/mypystick
Vocal Joystick:
https://www.youtube.com/watch?v=PXmccs4GIqI
Vocal Joystick Home Page:
https://web.archive.org/web/20100626050314/http://ssli.ee.wa...
University of Washington: Department of Linguistic: The Vocal Joystick
https://linguistics.washington.edu/research/projects-and-gra...
ACM UIST 2025
Frank Heyen, Marius Labudda, Michael Sedlmair, Andreas Fender
Nowadays, electric guitars are often used together with digital interfaces. For instance, tablature applications can support guitar practice by rendering and playing back the tabs of individual instrument tracks of a song (guitar, drums, etc.). However, those interfaces are typically controlled via mouse and keyboard or via touch input. This means that controlling and configuring playback during practice can lead to high switching costs, as learners often need to switch between playing and interface control. In this paper, we explore the use of audio input from an unmodified electric guitar to enable interface control without letting go of the guitar. We present GuitarPie, an audio-based pie menu interaction method. GuitarPie utilizes the grid-like structure of a fretboard to spatially represent audio-controlled operations, avoiding the need to memorize note sequences. Furthermore, we implemented TabCtrl, a tablature interface that uses GuitarPie and other audio-based interaction methods for interface control.
PDF: https://andreasfender.com/publications/PDFs/GuitarPie_author...
Pie Menu:
https://en.wikipedia.org/wiki/Pie_menu
https://donhopkins.medium.com/pie-menus-936fed383ff1
Markus Funk, Vanessa Tobisch, and Adam Emfield. 2020. Non-Verbal Auditory Input for Controlling Binary, Discrete, and Continuous Input in Automotive User Interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, 1–13. https://doi.org/10.1145/3313831.3376816
Guitarists have been using their picking hand or pedal controls since the beginning of the electric guitar without much fuss or concern.
I also thought pie menus died off because everyone decided they were too limited, hard to understand, and overall annoying regardless of the input method.
"Hard to understand" is on you, buddy. I wasn't aware that "everyone" got together and agreed on everything -- that seems like a suspicious claim. Where did you read that? Surely you can cite some papers and article by "everyone" as evidence, and you're just not making it up in an attempt to troll.