They might notice the bits of interstellar dust that at the upper size range hit at 0.99c with kinetic energy on the order of magnitude of tactical nuclear weapons yield. This also makes targeting interesting without thrusters and fuel to correct their probably regularly perturbed trajectories. Those cold, small, dark rocks may not be quite so cold or dark if they're going to actually try to hit their targets.