They certainly had a unit of account (bushels of grain, for example) to quantify debt, but they didn't have a currency, which has additional necessary criteria besides unit of account.

What these cultures had, according to Graeber, were essentially ledgers for keeping track of debt.