I love the feature, it literally takes two seconds to find out my balance, but yes, if someone borrows my phone or steals it, they can know how much money I have on one of my accounts. If you're the type of person who worries about that, simply don't activate the feature. :-)
(Oh, and you have to re-authorize the "quick-check" account once a month or something while being fully logged in to the bank app, so it automatically expires if you forget about it, which is a nice feature. Still, that's my boring old bank, and not cool and hip and revolutionizing GoBank... :-) )
I wish more apps support multi-level authentication to support this at-a-glance information. I'm perfectly fine with my balance being only behind a 4-digit passcode, but transfers should require a recent full password auth. That being said, designing and implementing such a system securely is easier said than done.