Rightly or wrongly its not about disservice to a victim turning up for jury duty its about disservice to the accused. Imagine if you were wrongly prosecuted for for abuse, found guilty and then discovered that three members of the jury had themselves suffered the same abuse you were accused of, you'd immediately look for a re-trial.