We detect these planets light years away when they go between us and some light source, or when they change orbit of some light source (thanks to gravity). If the body is cold and the background is black we won't see it until it's close to our sun.