You're most certainly not paranoid. Three-letter agencies have malware in the wild that can operate a webcam without turning on a light. It's probably well-targeted at specific people, but you can't know whether you're a target (until it's too late, anyway).

http://bgr.com/2013/12/18/apple-macbook-webcam-spying/