The problem is evidence and particularly eyewitness testimony (unreliable to begin with) decay with age. Banning absentia trials creates an incentive for people to hang out for a few years, then come back and say "all this evidence is too old, you should reasonably doubt its integrity".