Even an app that converted characters into the most direct meaning could provide insight in a large number of cases into the intended meaning and would be valuable.
An app that converted from characters to pinyin (a much easier problem) would be gold to someone trying to learn mandarin. I'd easily pay $50 for something with that functionality without it even making an attempt at the english. It's a much smaller market than those trying to understand chinese signs on a vacation, but it's one with a much larger stake and interest in the result.
The Chinese dictionary app Pleco has an OCR plugin.
Here's a video demo: http://www.youtube.com/watch?v=x7VTo0656Rc
On the other hand, an English to Chinese translator might be more doable, and might also be more commercially profitable.