It's boom and bust cycles. Big booms of fish when the conditions are right and the food is plentiful; big die-offs when the conditions swing the other way. There's always been enough fish that survive the bad times to spark the next boom.