prosa, great question - 100% think you must have a graphically appealing product out of the gate, but like you said, it is a fine line that you must walk. I try to test my thesis early and often, but my tests will only be taken serious if I put something out that is engaging. Quality must be there, but be mindful to not get caught up in the "extras" that will delay seeing if you should continue down your current path or course correct.
One thought/question: How much of an impact does a high-quality graphic design have on your perception? I'm betting that going the extra mile on the visuals can strongly aide the perception that the company is legit.