This is the biggest red flag I saw. You guys should be talking voice or meeting face-to-face more often. You will not solve personality issues via email that neither of you have a lot of time to spare for.
If the OP doesn't make at least a serious attempt to re-connect with his founder then he's at least half of the problem here.
Make time to work with your cofounder vocally, in-person if possible. It's too easy to dismiss concerns via email.
He's counting on you and you both have to put up with a lot. If you can make it through this by stepping back and realizing that it takes two to communicate, then the business has a chance. You might have to try harder to communicate with him but can you honestly say you've tried your absolute best to make it work? Are you going to let communication breakdown without trying as hard as you can to fix it?
Things will get harder as you go on-- this kind of a problem isn't a great sign either way, but if you don't try your hardest the bad sign may very well be about you. Be absolutely convinced you did everything in your power to compensate for his weaknesses (and yours).
If your heart isn't in it enough to try your damnedest, then perhaps that's the problem and not the communication issue. I'd still try to address that because it doesn't sound like it can get much worse if you're considering leaving.
The co-founder doesn't READ his emails/IMs let alone remembering what has been discussed.
I mean, you really can't make that a rule. I read (and re-read) important mails, I guess I'm not the only one, am I ?
In fact I have every client agree with me from the beginning that our emails serve as the written terms our agreements when we both agree in writing. And I ask them to always save every email they send me and every email they receive from me, so that we will both have a written trail of correspondence to refer to when (not if) there are any misunderstandings.
This system has served me well for many many years, so for someone to make an all-encompassing claim that no one reads emails is just plain ridiculous.
What I was trying to convey is that you'll constantly be surprised at the number of intelligent, educated, detail-oriented people who did not in fact read what you wrote.
If you optimize your communications to assume this, you will become a better communicator.
EDIT> There's another important subtext here. I've often seen the following pattern: developer is confronted with user behaviour, but continues to talk about "I do this, I do that", rather than internalizing that others do not do as he does.
But yea just leave, a conflict like this just gets worse and worse. Specially when one of the parties in the conflict doesn't realize there is one. If you really believe in this business you could always take in outside help but I believe that is your only chance to fix the actual issue.
If you aren't prepared to do that, run.