You should really shop around! In Europe I have a free credit card, with a large line of credit, that I literally never pay any interest on, that (used to) fly me to New York in first class once a year on normal household and business expense spending. They're out there - you're throwing away money by not using them.

In the US it's easy to get a zero-fee credit card. Most have rewards programs.

The personal finance advice I've heard is not "don't use credit cards" it is "don't carry a balance on credit cards."

Carrying a balance will eat you alive on interest. As will fees for late payments or going over the limit. If you have the self-discipline to not do those things, there's no reason to not use a credit card.