Right or wrong, it's a fairly common stereotype: a merchant who insists on cash-only transactions is dodging taxes or selling something illegal (or both, I suppose).

On the topic of criminal behavior, it's also worth noting that doing business cash-only makes you a more tempting target for robbery; if you did almost all of your transactions via credit or debit cards, you'd have very little in the till for someone to steal.