While it's not good, it's not that bad. A lack of biodiversity may, if taken to extremes, limit the variety of things humans have access to. However, even in that case, we should be able to rely on our wind pollinated crops (possibly with more genetic modification, if required) to feed us while we research synthetic alternatives to anything we start to loose access to.