The evidence is in this interview. It sounded like the board basically let Altman walk all over them until they suddenly decided that they wanted to fire him, but by then it was too late. For example, if they had a thorough paper trail documenting all of his lies, they could threaten a lawsuit pressuring him to resign. If YC fired him, they likely would have used a similar strategy to pressure him to step down without any blowback.