Because it hasn't been just his project since he began accepting patches. It's a reflection on every contributor and every member of the community. When a project is the product of many peoples work, dirtying the face of the project affects everyone.