How do we know punishment is not a deterrent to crime?

If there was no punishment for committing crimes, do you think the amount of crime would remain approximately the same and is there any good evidence for that?