It probably isn't worth spending $$$$ on logos. But you should care about design as an extension of caring about UX. If your design taste is sufficient that you can produce a simple, acceptable logo - great! If it isn't, it is possibly a warning sign that you need to involve someone who does have that design taste - and not just on your logo.
To head it off at the pass - yes, some start-ups have succeeded with weak design (although far fewer than you think - simple is not necessarily weak), but start-ups have succeeded under all sorts of circumstances. It doesn't invalidate the principle that a good user experience is very valuable to any product.
Often simplicity is the beauty of it. For example, simple code that works effortlessly isn't necessarily creative but it could be and when it works, it's beautiful. Because it's simple should it be cheap? Expensive? I don't think there's a correlation there.
Beauty can be the intricacy of simplicity.
Serious Question: how do you define/identify a cheap logo? I mean look at logos of most popular brands like Google, Facebook, Ebay, BBC, Microsoft, Paypal, Yahoo etc they are all extremely simply, just fonts with colors on them, nothing that could be called creative. Maybe even a non-designer could replicate them in five minutes. However despite all the simplicity, these logos are still stuck in our mind and do represent their respective products. So it really worth spending $$$$ on logos while starting up?