Or it is there (and maybe everywhere) but we can't hear it

One thing that's noticeable when it's really quiet (and having lived in a place where it is silent at night) is that the threshold of hearing changes a lot. Something that's barely audible in normal conditions can "scream" at night

Example: the sound of soda fizzing in your mouth.