Their environment is one where humans prey on them, especially on the large ones. It's a selection pressure like any other and becoming smaller on average makes them more fit for that environment.