Depending on the speed of an interstellar craft, even trace amounts of dust between stars could be a source of significant erosion over a long enough period of time.