However, no serious NLP researcher would suggest building a text-to-speech system by getting rid of the middle OCR layer and just hooking the raw image directly to the expected sound. (Well, at least I think so, but I'd be glad to know if I'm wrong.)
Phonemes are absolutely imposed on human babies. Sure, they wouldn't know the word "phoneme", but that doesn't make the concept any less real. Imagine how a typical education on reading/writing would start like: "This is G. It is used for words like grass, game, and girl. Actually, it can also be used for gem or genie!"
Can you imagine an English-speaking child listening to this and not immediately understanding that there are two distinct sounds involved, that the first sounds for "grass", "game", and "girl" are somehow the same (even though the waveforms are different), and that this sound is somehow different from that of "gem" or "genie"? If a child doesn't understand it, then the child probably needs a speech therapy.
Perhaps you're thinking mainly of Western writing systems?
Presumably since Andrew now works for Baidu, he is particularly interested in reading Chinese. The interesting thing about Chinese is that, as I understand it, the same symbols can have different pronunciations in different dialects, but all pronunciations mean the same thing.
I.e. the symbol has a unique meaning, but multiple possible sounds. Which implies the sound isn't really what's important here.
As Ng noted, phonemes are artificial constructs. If they are necessary for a particular language then they should be learned in the same way other constructs are, not imposed on the learning algorithm from the outside.
Are phonemes imposed on human babys? Maybe if you were raised by Hooked on Phonics[1], but I'd wager that most humans did not have the idea imposed on them.
[1] http://en.wikipedia.org/wiki/Hooked_on_Phonics