Unlikely, but possible (if the probe was really big or really chatty in parts of the spectrum we pay attention to). Tiny probes could pass by us without us noticing them I'd think, though if they needed to send transmissions back toward their origin we might pick that up.