Is there a fairness issue if the conf is not gender diverse enough? (but does blind speaker selection, and offers the same compensation to any prospective speaker)

If it seems like a literal boys club, maybe it's ok if organizers don't cajole women to attend, who don't seem to want to.