It would still be visible in the fossil record, IMHO. Stone can still form around structures that long faded away, and there is zero evidence of any tool before our recent relatives (apes).

EDIT: fossil record -> geological record.