You can pretty trivially set credit cards to auto-pay and use them as debit cards, with the only difference being a delay in any overdraft penalty.

Sure, if you overspend you get heavily penalized, and that's not great, but you don't have to spend a dime of interest to build a respectable credit score.