Couldn't agree with you more. So much so we actually are building a company to help developer do just that - http://slanglabs.in :) Provide tools to developers to build a voice interface on top of existing mobile apps that in our mind would marry the best of voice (as an input mechanism) with GUI (as an output mechanism).
What I think is really the killer feature of speech recognition is its role as an input. Anecdotally, I find the only times I use any voice UI is for setting alarms (because iOS's time input makes you scroll thru every minute) and asking a sufficiently long question to Google (because touchscreen keyboards are still imprecise and I've got fat fingers). Even though both Android and iOS have speech recognition built into their keyboards I think there's something someone is missing on the input side.