I agree 100%. If I'm paying for a conference I want the best speakers and content - if you can deliver that with diversity I'm all for it. If you're number one priority is diversity and it means your content and speakers are sub-par, I'm going to stop coming.

I think the more important issue is to make sure you selection committee is not biased. While it might be nice to have a selection committee made up with the front-page names in the start-up industry, you'd probably be better off skipping those that act more like fraternities.