News for hackers. Stuff that matters.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by danteembermage on Thursday September 15, 2011 @07:29PM (#3002516)
I think a killer feature for this (or a competitor...) would be auto-turning pages using the ambient audio. "While I am playing piano and have no hands I have to deftly change the music, therefore I need another human" is a huge pain point for performing pianists.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by jerf on Thursday September 15, 2011 @09:26PM (#3002780)
I'd think out of the box on this, and just give the user another channel to control the page turning. The most natural choice I could see would be some sort of eye or head tracking. Though I suspect that rather than trying to guess where they are in the sheet music, I'd just give them a visual target off to the right or left that if they gaze upon/turn towards it the page turns forward (or back).

The problem with solutions based on tracking where we are in the music, then inferring the correct action, is that it still encodes assumptions about when the page should be turned, which is great... until it's wrong.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by nandemo on Thursday September 15, 2011 @10:27PM (#3002940)
> I'd think out of the box on this, and just give the user another channel to control the page turning. The most natural choice I could see would be some sort of eye or head tracking.

I think the most natural is a pedal, which has actually been implemented.

Grandparent's suggestion of ambient audio seems rather inadequate. Pianists don't turn pages always at the very end of the page. They read ahead, and how much they read ahead depends on the particular passage.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by jerf on Thursday September 15, 2011 @11:34PM (#3003095)
"which has actually been implemented."

Yes, I implicitly added a requirement for myself that I not merely duplicate off-the-shelf tech, because that would be boring. One characteristic of that solution is that it requires additional hardware, whereas head tracking (and maybe eye tracking) could be done with the same setup pictured in the article. But I would totally agree that given a pedal, that will be the superior solution on almost every level. Truly, nothing else speaks with the input clarity and precision of a simple button.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by zach on Thursday September 15, 2011 @08:05PM (#3002589)
The hurdle for this is that to do it well, you need polyphonic pitch detection, which you could say is a little tricky.

However, I worked on the prototype for a music app that does polyphonic pitch detection for a greater effect than page turning. It listens and follows along note by note as you play your (real) guitar and, as you hit the notes properly, actually uses the master tracks of rock songs to give you a very cool sensation of playing the real song. It's called Rock Prodigy: Guitar and is free with per-song IAPs if you want to try it out.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by waqf on Thursday September 15, 2011 @08:32PM (#3002647)
Following an existing score should be a lot easier than de novo polyphonic transcription. For example, you could almost just track the beat while ignoring all the pitches.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by zach on Thursday September 15, 2011 @09:15PM (#3002755)
With a rhythm-game type app, you can dictate what the user is supposed to be playing. With a sheet music app, not so much.

People will want to play the first few measures over and over, try something again after messing it up, stop and take it from the top and so on. If you turn the page too soon or scroll the music the user is playing off the screen, the customer reviews are going to look like Armageddon has come.

The only way I see that works understandably and well enough is to recognize when the last measure of the last staff is completed. Even that may be incompatible with some music, but it should work well enough in general.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by high5ths on Thursday September 15, 2011 @09:20PM (#3002767)
It's impossible to do that with a lot of non-standard notational music. And even with standard music, "the beat" is annoying to track and changes FAR more than you'd expect. Good musicians are constantly altering the beat in subtle and unsubtle ways.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by dangrover on Friday September 16, 2011 @01:16AM (#3003285)
Exactly. Rhythm quantization is one of those things that no app ever gets right.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by phlee on Friday September 16, 2011 @04:29AM (#3003648)
I've been working on converting midi/virtual midi input (from a performer) to notation in real time for an iPad notation app. It really is hard - I spent a tremendous amount of time on it, an still plan on improving it indefinitely after the feature ships.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by dangrover on Friday September 16, 2011 @10:13AM (#3004495)
Dude, your app rocks. We tried to get in touch with you a while back with no response.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by phlee on Saturday September 17, 2011 @03:42PM (#3008773)
Thanks. If you want to connect, email me [email protected].
Re:Rethinking Sheet Music, With A Few Bells And Whistles by usedtolurk on Friday September 16, 2011 @12:40AM (#3003222)
Is there even a need for pages anymore? Wouldn't it be nicer to have one long continuous sideways scroll in landscape mode.

Even better if the App was able to match the scrolling speed to the playing speed automatically.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by high5ths on Friday September 16, 2011 @02:09AM (#3003362)
Playing speed changes over time, and the problem with continuous scroll is that musicians often need to look away from the music -- at their hands, feet, at other musicians or the conductor -- and if the music has moved in the meantime, it is disorientating and not useful. That's why a page-based model is still the only way to work, even when you think a scrolling model is more efficient.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by __david__ on Friday September 16, 2011 @02:58AM (#3003450)
Not only that, but a lot of times you memorize different sections by their physical placement on the page. To lose that orientation would make memorization harder.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by Bud on Friday September 16, 2011 @02:20AM (#3003380)
Another real-life need for pages (and page numbers) is for easy reference in rehearsals. You don't want to wait while 100 people figure out how to scroll to a given point without common reference points (although, yes, bar numbers would work, too).

I also heartily agree with the commenter who noted that continuously-scrolling music would be disorienting in real use.

Re:Rethinking Sheet Music, With A Few Bells And Whistles by dangrover on Friday September 16, 2011 @04:50AM (#3003690)
Tried that with the iPhone version that came out in March last year. In practice it was silly and people liked the iPad version better.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by muxxa on Friday September 16, 2011 @05:12AM (#3003738)
I wonder have you thought of splitting pages in two, and showing the top half of the next page while you are playing through the bottom half of the current page? This would keep pages static. (I wish this could be implemented on my Kindle also, as I often push the button for the next page too early, and then have to turn back again to read the last 3 words).
Re:Rethinking Sheet Music, With A Few Bells And Whistles by neonscribe on Thursday September 15, 2011 @09:37PM (#3002809)
Here's a much simpler solution: a page-turning pedal: http://www.bilila.com/pagescore_turner
Re:Rethinking Sheet Music, With A Few Bells And Whistles by high5ths on Friday September 16, 2011 @02:10AM (#3003364)
Re:Rethinking Sheet Music, With A Few Bells And Whistles by yalimgerger on Thursday September 15, 2011 @07:32PM (#3002521)
Tonara does this.
Re:Rethinking Sheet Music, With A Few Bells And Whistles by dangrover on Thursday September 15, 2011 @07:39PM (#3002536)
I'm excited about Tonara, but the app itself seems like a tech demo for that specific technology.

They have yet to experience the pain of a thousand cuts that (that my team and I have gone through) that is working with the music publishing industry.

The thing with these apps is that people who don't really understand them group them all together. "Oh, another music-y app for fancy music people!"

While their app now is not remotely a competitor, if they actually get some real funding, they could pivot in a number of ways to compete against apps like mine, because they've been able to position themselves well in the "music app startup" slot by presenting at TC.