The point being that initially it seemed safe to stay - that this case would go away and was genuinely just about those allegations. Then the longer it went on, the more unusual the case seemed.

Whether or not it was unusual enough to justify Assanges fears is irrelevant. The question is whether or not they were enough to cause him to start fearing something else was going on.