I think a good moment to start thinking about this is when you are legally required to have an Ondernemingsraad [1]. Which is at 50 employees.
It's an arbitrary threshold, but seems like a good point in the life of a company where it transitions from a small company to a larger one, where you need to start making various informal policies and company customs and values more formal.
[1] http://nl.wikipedia.org/wiki/Ondernemingsraad_%28Nederland%2...
The issue is at what point does the need for diversity kick in? If I start a startup right now with a friend, a person who is much like myself, very few people will criticize us for diversity issues at 2 people. But if we continue to hire friends, when does it become a diversity issue that needs addressing?