Possibly not. Most asteroids are far out, and the giant planets tend to knock them our way. Mercury is also a smaller target.

Earths atmosphere protects us from all but the biggest rocks. Micrometer impacts on Mercury are a real danger, but that's also true in space/moon/mars