No, this is all the time. It is only quiet when the phone is idle.

I considered returning it, but I find it charming. I miss the days when you could tell exactly what your PC was doing by all the sounds it was making, and I find dead silent electronics to be elegant but a little sad.