It's not my startup under discussion, actually (I wasn't the first commenter above), but to be fair the first choice for a tiny startup might well be "stick with the shell scripts and dead-simple architecture for now" rather than any CI at all, hosted or not.
Thanks for putting up the more relevant comparison price point, though, and I do agree with you that outsourcing non-core functions is essential to getting real work done on the actual product.
If your tiny startup isn't able to afford a couple of hundred dollars a month for various hosted services after 3 months, then you're prioritizing wrong. You need to focus on building a valuable product and getting it to customers, not on building your own internal setup to save a little bit of money. Companies doing the former are much more likely to succeed than those doing the latter.