There would probably be a need for a mechanism to ensure objectivity. E.g., if Reviewer A rejects Reviewer B, there may be a higher chance Reviewer B will reject Review A's future work, just out of spite.