You're right to question it, there is no evidence of the idea Adam Smith promulgated (that barter societies were natural). Ancient societies used a credit system with debt being the social tie that binds a community together