Wouldn't this also be the case if you sold your primary domain? History would potentially be rewritten by the new owner. I think it's just a general problem with link decay.