But we should these things based on evidence, not just accusations.

Its very hard from a legal perspective to establish "beyond reasonable doubt" (or even "preponderance of evidence") with just the word of one person. You would probably need something else too.