I can't speak for OP's situation obviously, but in most union contexts a person on the bargaining committee is answerable to other members, subject to removal, and reliant on re-election. Some organizations have practices of job rotation or term limits to ensure no single individual is irreplaceable.