Diversity programs are best viewed as a relatively cheap marketing expense. They exist to make the company look better to certain people. When there are more pressing concerns, you pare them back because you have better things to worry about that what non-customers think of you.