I wouldn't be at all surprised that it would light up with the phone off too, or really with any metal material set on it. You've got a free antenna set above an already noisy circuit: the Arduino plugged into a laptop via USB. Putting a metal cover over the antenna could easily be enough to increase the field strength.