Until he is criminally charged, I view such rumour mongering as simply a smear campaign against an innocent man. You can take a more "worried" view, but I believe we should hold more tightly to innocent-until-proven-guilty than is the norm these days.