I've heard such noises before on my PalmPilot Professional. In a quiet room, I can hear a distinct hissing sound when I turned it on.

Capacitors can also play music apparently. During audio testing of a speaker system in my company, I could distinctly hear music coming from a speaker board with no speakers attached. It turns out I was hearing the audio generated by the capacitors on the board.